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1.  INTRODUCTION 


This  paper  proposes  a new  formulation  of  consumer  demand 
functions.  The  fundamental  assumption  of  the  formulation  is  that  a 
consumer  spends  his  money  in  such  a way  that  the  marginal  utility  of 
expenditure  equals  a constant,  which  is  independent  of  prices  and  does 
not  change  over  time.  This  assumption  will  be  termed  the  permanent 
income  hypothesis  because  of  its  similarity  to  the  hypothesis  of 
F riedman  1 7]  . 

The  permanent  income  hypothesis  proposed  here  is  somewhat 
different  from  that  of  Friedman.  The  hypothesis  studied  here  is 
intended  to  be  a theoretical  representation  of  a consumer's  response  to 
short-term  fluctuations  in  prices,  his  needs,  and  his  income.  Because 
of  the  theoretical  orientation,  the  hypothesis  is  stated  in  terms  of  an 
unobservable,  fictitious  quantity,  the  marginal  utility  of  expenditure . 
Friedman  is  concerned  with  the  relation  between  consumption  spending 
and  current  and  past  income  and  other  variables.  His  hypothesis  is, 
roughly,  that  consumption  spending  consists  of  a random  term  plus  a 
multiple  of  some  weighted  average  of  past  and  expected  future  incomes 
(Friedman  [7,  Chap.  III]).  Because  of  Friedman's  empirical  orientation, 
his  hypothesis  is  a statement  about  quantities  which  are  directly  or 
indirectly  observable. 

Both  Friedman's  hypothesis  and  that  of  this  paper  are  based  on 
the  same  idea,  that  consumers  try  to  compensate  for  economic  fluctu- 
ations by  saving  and  dissaving.  The  same  idea  lies  behind  the  life  cycle 
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model  of  Modigliani  and  Brumberg  [10) , which  is  very  similar  to 
Friedman's  hypothesis. 

Some  economic  implications  of  the  permanent  income  hypothesis 
of  this  paper  are  explored  in  two  other  papers  [3,  4]  . These  papers 
attempt  to  show  that  this  hypothesis  clarifies  the  economic  significance 
of  general  equilibrium  theory.  This  paper  attempts  to  clarify  and 
defend  the  hypothesis  itself  by  stating  it  precisely  and  demonstrating 
when  it  is  applicable. 

The  permanent  income  hypothesis  may  be  stated  mathematically 

as  follows.  Let  Un(cn)  be  the  utility  of  the  consumption  bundle 

0 = (c  c T ) purchased  in  period  n.  Suppose  that  U is  differen- 

n nl  ’ ‘ ' ‘ ’ nL 

tiable  and  defined  for  all  L-dimensional  vectors  with  non-negative 
components.  Let  Pn  = <pnl, . . • , PnL>  be  the  vectors  of  prices  in 
period  n.  The  hypothesis  asserts  that  there  exists  a number  X such 
that  the  following  is  true  for  all  n and  i. 

3U  (c  ) 

— ^ — — £ \p  . , with  equality  if  c . > 0 . 

3c  . *ni  ’ ni 

m 

\ is  independent  of  n,  pR,  and  of  expenditure,  Pn  * cn. 

The  permanent  income  hypothesis  may  be  stated  in  terms  consistent 

with  the  usual  model  of  the  consumer.  If  money  is  included  in  the 

list  of  commodities  and  if  the  price  of  money  is  set  equal  to  one,  then 

the  consumer's  transactions  must  satisfy  the  accounting  identity , 

M + d • c = M where  M is  the  quantity  of  money  he  has  at  the  begin- 
rn  n n 

ning  of  period  n,  c is  the  vector  of  commodities  purchased,  and  M is 
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the  quantity  of  money  retained  after  the  purchases.  That  is,  in  period 
n the  consumer  is  restricted  to  the  budget  set 

B = {(M,c)|  M + p • c - M .M^O.c^O}. 

The  permanent  income  hypothesis  may  be  interpreted  as  the  following 

two  assertions.  (1)  The  consumer  chooses  a point  in  B which  maxi- 

n 

mizes  a utility  function  of  the  form  X.M  + Un(c).  (2)  is  so  large  that 
if  (M,c)  is  the  point  chosen  in  B^,  then  M > 0. 

The  permanent  income  hypothesis  is  a mathematical  representation 
of  a consumer  who  has  in  mind  a definite  idea  of  the  value  of  a dollar  and 
spends  money  on  a commodity  up  to  the  point  at  which  the  value  of  the 
quantity  bought  with  an  additional  dollar  equals  the  value  of  the  dollar 
spent.  The  value  of  a dollar  may  also  be  thought  of  as  the  consumer’s 
willingness  to  spend. 

Of  course,  one  cannot  believe  that  in  reality  a consumer's 
willingness  to  ^pend  would  be  completely  fixed.  But  it  is  not  hard  to 
imagine  that  under  certain  conditions  it  would  be  nearly  fixed,  so  that 
it  would  be  reasonable  to  assume,  for  simplicity,  that  it  is  fixed. 

The  conditions  which  could  give  rise  to  a nearly  constant  willing- 
ness to  spend  include  the  following:  (1)  fluctuations  in  the  economic 
environment  or  the  consumer's  needs  which  are  frequent,  not  very 
large,  and  tend  to  offset  each  other  over  a period  of  a few  years, 

(2)  nearly  correct  anticipation  by  the  consumer  of  the 
(statistical)  nature  of  the  fluctuations,  and  (3)  possession  by  the  con- 
sumer of  an  adequate  supply  of  liquid  assets. 

Economic  common  sense  indicates  that  under  these  conditions. 


a consumer  would  respond  to  fluctuations  largely  by  saving  and  dissaving 
If  he  allowed  his  willingness  to  spend  to  fluctuate  widely,  he  could 
increase  his  total  enjoyment  by  spending  a dollar  less  when  money  was 


worth  relatively  little  to  him  and  a dollar  more  when  money  was  worth 


However,  even  if  the  conditions  listed  above  were  satisfied,  one 


would  expect  the  consumer's  willingness  to  spend  to  vary  somewhat. 
Oscillations  in  his  holdings  of  liquid  assets  would  certainly  affect  his 
attitude  toward  money.  Or,  runs  of  good  or  bad  luck  could  affect  his 
expectations  about  the  future.  But  these  influences  would  probably 
cause  only  small  and  gradual  changes  in  the  consumer's  behavior. 

Such  changes  might  be  gradual  even  if  the  listed  conditions  were 
not  all  satisfied.  For  instance,  though  a consumer  probably  would  not 


be  willing  or  able  to  compensate  for  long-term  economic  oscillations 
by  saving  and  dissaving,  such  oscillations  would  be  gradual.  A con- 
sumer's expectations  might  be  incorrect,  but  the  presence  of  rapid 
fluctuations  might  make  it  impossible  for  him  to  discern  his  mistake 


The  permanent  income  hypothesis  would  be  completely  inappro 


priate  if  applied  to  a consumer  living  a hand-to-mouth  existence  or  to 
a consumer  subject  to  abrupt  and  radical  change.  A sudden  change  in 


expectations  or  a sudden  large  scale  loss  of  financial  assets  certainly 
could  be  expected  to  affect  a consumer's  willingness  to  spend.  Also, 
the  permanent  income  hypothesis  should  not  be  applied  to  long-term 
changes.  The  consumer's  willingness  to  spend  might  well  change 
markedly  after  a long  period  of  time  if  some  long-term  change  occurred 


- 5 - 


in  his  circumstances. 


One  might  accept  the  permanent  income  hypothesis  on  the  basis 
of  intuition  and  common  sense  alone.  But  since  the  hypothesis  is  stated 
in  terms  of  marginal  utility  and  since  it  is  traditional  to  assume  that 
consumers  are  precise  utility  maximizers,  it  is  natural  to  give  a demon- 
stration of  the  hypothesis  in  terms  of  the  consumer's  maximization 
problem.  Most  of  this  paper  is  devoted  to  such  a demonstration. 

There  are  many  ways  to  formulate  the  consumer's  maxi- 

mization problem.  For  instance,  the  nature  of  his  problem  depends  on 
the  form  of  his  utility  function  and  on  whether  he  is  allowed  to  borrow. 


Since  borrowing  gives  the  consumer  additional  flexibility,  it  seems 
clear  that  the  permanent  income  hypothesis  would  be  easier  to  demon 
strate  if  borrowing  were  permitted.  For  this  reason,  it  is  assumed 


that  the  consumer  cannot  borrow. 

Since  the  consumer  cannot  borrow,  his  money  balances  cannot 
become  negative.  If  he  begins  period  n with  Mn  units  of  money  and 
buys  a bundle,  cn,  during  the  period  at  a price  vector,  pn,  then  it  must 
be  that  p - cn  ^ Mn.  It  will  be  assumed  that  the  consumer  receives 
income  at  the  end  of  the  period.  The  income  received  at  the  end  of 
period  n will  be  denoted  by  yn+r  (The  subscript  n+1  appears  because 
the  consumer  does  not  necessarily  know  yn+1  at  the  beginning  of  period 
n,  but  he  does  know  it  at  the  beginning  of  period  n+1.  ) The  consumer 

begins  period  n+1  with  Mn+^  = Mn  Pn  ’ cn  + ^n+1  units  money* 

For  simplicity,  it  will  be  assumed  that  yn  is  a random  variable 

which  is  not  affected  by  any  of  the  consumer’s  actions.  A more  general 

model  would  allow  the  consumer  to  vary  the  quantity  sold  of  his  endowment 


(of  labor , for  instance)  and  would  allow  this  quantity  to  affect  his  income 
and  utility. 


It  is  convenient,  though  probably  not  necessary,  to  assume  that  the 


consumer's  utility  function  is  additively  separable.  That  is  the  utility 

N-l  ’ 

of  a consumption  stream  Cq.Cj,...  .c^,  is  £ 6nUn(cn),  where  cn  is 

the  bundle  consumed  in  period  n and  6 is  the  discount  rate  on  utility  and 

0 < 6 < 1.  It  simplifies  matters  to  replace  the  functions  U with  the 

n 

indirect  utility  functions  un(x)  ~ max  U (c),  where  x is  the  expendi- 

Vc"“ 


C 5*  0 


ture  during  period  n and  pn  is  the  vector  of  prices  during  this  period. 
un  ^e  assumed  to  be  random.  Note  that  this  randomness  can 

derive  from  randomness  in  both  U and  p 

n Mi' 

It  could  be  assumed  that  {yn}  and  {u^}  are  sequences  of  independ- 
ently and  identically  distributed  random  variables.  (If  this  assumption 
were  made,  our  results  would  generalize  only  slightly  work  of 
Schechtman  [14]  . His  work  is  discussed  further  below.  ) However,  it 


does  not  seem  appropriate  to  make  such  an  assumption  in  the  context 
assumed  in  this  paper.  The  time  periods  are  to  be  thought  of  as  short, 
as  days,  for  instance.  Hence,  if  the  random  variables  were  independ- 
ently and  identically  distributed,  fluctuations  would  persist  for  only  one 
day.  This  seems  unreasonable.  People  learn  from  the  recent  past.  In 
a world  in  which  the  events  of  one  day  are  independent  of  past  events, 
no  learning  is  possible  (once  the  probability  distribution  of  the  random 
variables  is  known).  Also,  people  have  a great  deal  of  information  about 
economic  life  and  use  it  to  anticipate  future  events.  One  way  to  model 


rvl 


r 
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this  aspect  of  life  is  to  assume  that  the  consumer's  economic  environment 

is  described  by  a stochastic  process.  The  consumer  observes  this  process 

and  knows  its  probability  distribution.  Past  observations  of  this  process 

form  the  consumer's  information.  Known  correlations  between  past  and 

future  events  make  it  possible  for  him  to  use  this  information. 

It  is  assumed  here  that  there  is  in  the  background  a stationary 

stochastic  process  lu  },  and  that  u and  y are  functions  of  u . Because 
r 1 nJ  n ■'n  n 

yn  and  un  are  functions  of  un,  {yn}  and  {un}  form  stationary  processes 

as  well.  It  is  to  be  emphasized  that  the  consumer  knows  cj  and  that  w 

may  contain  much  information  besides  knowledge  of  y^  and  u . For 

instance,  it  may  contain  the  latest  weather  forecast  or  knowledge  that 

the  consumer  has  the  flu  and  will  be  sick  for  a week.  w should  be 

n 

thought  of  as  a vector  with  many  components  which  express  all  that  the 
consumer  might  learn  during  period  n-1.  At  the  beginning  of  period  n, 
he  knows  {u  : k < n}. 

To  assume  that  a stochastic  process  {u^}  is  stationary,  is  to 
assume,  essentially,  that  the  probability  distribution  of  future  values 
of  the  random  variables  un  is  inferrable  from  knowledge  of  the  (infinite) 
past.  Hence,  it  is  at  least  somewhat  reasonable  to  assume,  as  is  done 
here,  that  the  consumer  knows  the  probability  distribution  of  the 
process,  conditional  on  knowledge  of  the  past. 

Stationary  processes  allow  for  a wide  range  of  stochastic 
phenomena.  In  the  next  section,  an  example  is  given  of  a process  for 
which  the  time  paths  are  periodic. 

It  is  natural  to  formulate  the  consumer's  maximization  problem 


conditional  on  the  information  available  to  the  consumer  at  the  beginning 
of  period  zero. 


1.  1 Problem 


subject  to: 

(1)  For  all  n,  is  a random  variable  which  depends  only  on 
information  available  at  the  beginning  of  period  n. 


(3)  is  given  and  for  n > 0,  M = M 


The  discount  rate,  6,  above,  is  assumed  to  be  such  that  0 < 6 < 1 


If  the  fluctuations  in  y and  u are  rapid  and  one  is  concerned  with 


the  behavior  of  the  consumer  over  short  periods  of  time,  then  one  can 
think  of  the  horizon  N as  large  and  the  discount  rate  6 as  close  to  one. 
Therefore,  the  permanent  income  hypothesis  has  to  do  with  the 
asymptotic  behavior  of  the  solution  to  Problem  1 . 1 as  N goes  to  infinity 
and  6 goes  to  one . 


The  results  proved  in  this  paper  may  be  sketched  easily.  Enough 
assumptions  are  made  so  that  it  is  not  hard  to  show  that  Problem  1.  1 


has  a solution.  The  un  are  assumed  to  be  differentiable,  strictly  con 
cave,  and  increasing,  as  is  usually  done  in  such  problems.  Certain 
other  more  technical  assumptions  are  made.  The  maximum  value  of 


the  objective  function  in  Problem  1.1,  VN(5(M),  depends  differentiably 
on  the  initial  stock  of  money,  M.  The  derivative  of  this  function  with 


respect  to  M , defines  the  marginal  utility  of  money  in  period 

zero  for  the  N-period  problem  with  discount  rate  6.  This  marginal 
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utility  of  money  is  a non-decreasing  function  of  N and  6,  as  is  to  be 
expected.  For  if  <5  is  increased,  greater  value  is  given  to  future  con- 
sumption, and  if  N is  increased  the  consumer  has  more  opportunity  to 
use  his  money.  Certain  assumptions  are  made  which  put  an  upper 
bound  on  the  marginal  utility  of  money.  Therefore,  V^IM)  converges 
as  N goes  to  infinity  and  6 increases  to  one.  The  limit,  Xg(M),  will  be 
called  the  limit  marginal  utility  of  money.  Clearly,  Xq(M)  is  a non- 
decreasing function  of  M. 

N-L 

Observe  that  V^OVI)  = max  e(  ^ Un^xn^^0/  *S  a 


x0>  • • • >XN-1 


n=0 


random  variable.  Hence,  V^IM)  and  XQ(M)  are  random  variables 
as  well. 

If  one  solves  the  problem 

N+n-1 

X 

k=n 


IN  »il  1 

max  E ( V 6kuk(xk)|.^n) 


N+n-1 


for  n > 0 and  goes  to  the  limit  with  N and  6 as  above,  one  obtains  a limit 

marginal  utility  for  period  n,  X^IM). 

The  optimal  spending  policy  for  the  N-period  problem  wdth  discount 

rate  6 prescribes  expenditures  in  period  n,  x]\j5n^n^>  as  a function  of 

the  consumer's  stock  of  money,  M in  that  period.  The  functions  x^n 

are  non-increasing  as  functions  of  N and  6,  as  is  to  be  expected  since 

money  becomes  more  valuable  as  N and  <5  increase.  Since  x^6n<M)  » 0, 

lim  xjSJ5n(M)  exists.  The  limit  will  be  denoted  by  x^lM). 

N-*oo 

6 1 1 

The  functions,  x , describe  a limit  policy.  This  limit  policy 

corresponds  to  the  limit  marginal  utility  of  money,  X^M),  in  the  sense 

that  u'(x  (M))  « X (M)  with  equality  if  x (M)  > 0.  The  limit  policy 
n oon  n °°n 
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gives  rise  to  a sequence  of  money  stocks  defined  as  follows:  Mq  is  given 

and  for  n > 0,  = Mn_j  * Xoo  n-l*Mn-l^  + yn'  The  secluence  is 

the  time  path  of  the  marginal  utility  of  money  if  the  limit  program  is 

followed. 

To  each  level,  X,  of  the  marginal  utility  of  money,  there  corre- 
sponds a unique  level  of  expenditure,  x,  in  period  n.  x is  such  that 
u^(x)  ^ X,  with  equality  if  x > 0.  x is  , of  course,  a random  variable.  It 
will  be  shown  that  there  is  a unique  constant,  X,  such  that  if  the 
marginal  utility  of  money  were  X in  every  period,  then  asymptotically 
the  consumer's  average  spending  per  period  would  equal  his  average 
income  per  period.  X would  be  the  marginal  utility  of  money  if  the  con- 
sumer sought  to  maximize  his  asymptotic  average  flow  of  utility  per 
period  and  were  constrained  only  to  match  his  asymptotic  average 
spending  to  his  asymptotic  average  income. 

The  main  theorem  is  that  lim  X (M)  = X,  for  all  n.  This  theorem 

M-°o  n 

says  that  if  the  horizon  were  sufficiently  distant  and  the  discount  rate 

sufficiently  close  to  one  and  if  the  consumer  had  a sufficient  quantity  of 

money,  then  the  optimal  marginal  utility  of  expenditure  would  be  nearly 

constant.  Also,  the  consumer  would  behave  nearly  as  if  he  were 

constrained  only  to  match  his  average  spending  and  income. 

A second  theorem  (Theorem  3.  2)  is  that  lim  X (M  ) = X , for  all 

n n 

n-*°o 

values  of  the  initial  money  stock,  Mq.  This  theorem  says  that  if  the 
horizon  were  sufficiently  distant  and  the  discount  rate  sufficiently  close 
to  one  and  if  the  consumer  followed  his  optimal  program,  then  he  would 
eventually  accumulate  enough  money  to  bring  the  marginal  utility  of 
money  close  to  X. 


i 


' 

i 


i 

I 


The  interpretation  of  these  theorems  would  be  suspect  if  the  limit 

policy,  x^^,  were  somehow  wrong.  To  check  that  the  passage  to  the 

limit  from  x^£n  to  is  legitimate,  it  is  proved  that  the  limit  policy 

is  optimal  in  the  limit  average  sense  (Theorems  3.4  and  3.  5). 

Most  of  the  results  of  this  paper  are  proved  by  Schechtman  [14] 

in  a special  case.  He  assumes  that  the  utility  functions  un  are  not 

stochastic  and  do  not  depend  on  n.  All  random  variation  comes  from 

the  y , which  he  assumes  to  be  independently  and  identically  distributed. 

(Also,  he  assumes  that  6 = 1.)  He  proves  that  lim  x (M)  = Ey„  and 

r . °on  17  0 

that  if  y is  not  deterministic,  then  lim  M = °o.  The  first  of  these 
J n n 

n-*oo 

results  corresponds  to  the  main  theorem  here,  and  the  second  corre- 
sponds to  Theorem  3.2  (that  lim  X (M  ) = X). 

n— oo 

Schechtman's  theorem  that  lim  M = <x>  is  true  under  the  assump- 

n 

n-»°o 

tions  of  this  paper,  provided  that  there  is  sufficient  randomness  in  the 
incomes  or  utility  functions.  This  fact  is  not  proved  here,  but  it  is 
worth  noticing,  for  it  draws  attention  to  the  fact  that  actual  consumer 
behavior  should  be  thought  of  as  only  approximating  that  implied  by  the 
permanent  income  hypothesis.  No  consumer  would  go  on  accumulating 
money  indefinitely.  However,  average  holdings  of  liquid  assets  by 
American  consumers,  apparently,  are  fairly  high.  Holdings  of  liquid 
assets  (checking  and  savings  accounts)  and  investment  assets  (stocks 
and  bonds)  together  amount  to  about  6 to  15  months'  income.  Holdings 
of  liquid  assets  alone  are  equal  to  one  to  two  months'  income  [11, 
pp.  100-103]  . However,  these  figures  are  very  rough,  for  there  is 
wide  variation  in  the  data  cited,  and  the  median  ratio  of  assets  to  in- 
come increases  sharply  with  income. 


Returning  to  the  work  of  Schechtman,  it  is  clear  that  the  results 
reported  here  simply  generalize  those  of  Schechtman . There  is,  how- 
ever, an  important  distinction  between  his  methods  and  those  of  this 
paper.  He  uses  the  techniques  of  dynamic  programming.  The  key 
arguments  of  this  paper  depend  on  the  strong  law  of  large  numbers  for 
stationary  stochastic  processes. 

Schechtman 's  method,  essentially,  is  to  study  properties  of  a 
solution  to  a limit  form  of  the  following  dynamic  programming  equation 
f°r  Vn6(M),  Vn  + 1 6<M)=  max  [ u(x)  + 6E M-x+y)]  . In  his  setting, 
is  deterministic,  for  the  random  variables,  y , are  mutually 


independent 


In  this  paper,  VN,(M)  is  a random  variable.  Because  randomness 


is  generated  by  an  arbitrary  stochastic  process,  current  information 
may  improve  knowledge  of  the  future  and  so  affect  the  value  of  VNfi(M). 
Since  VN6<M)  is  random,  the  dynamic  programming  equation  for  VN§(M) 
loses  much  of  its  value. 


The  proof  of  the  main  theorem,  given  in  section  7 of  this  paper, 
is  the  most  original  part  of  this  paper  from  a mathematical  point  of  view 
It  makes  no  use  of  dynamic  programming,  but  is  based  simply  on 
economic  common  sense  and  the  strong  law  of  large  numbers. 

The  assertion  that  nlim  Xn(Mn)  = X.  (Theorem  3.  2)  is  a direct  con- 
sequence of  the  main  theorem  and  the  convergence  theorem  for  super- 
martingales. This  theorem  is  proved  in  section  8.  The  idea  of  using 
the  convergence  theorem  for  supermartingales  is  borrowed  from 
Schectman. 


The  other  two  theorems  of  this  paper  (Theorems  3.4  and  3.  5) 
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follow  directly  from  the  main  theorem  and  Theorem  3.2.  They  are 
proved  in  section  10. 

The  fact  that  V,.TJ-(M)  is  random  introduces  certain  technical  diffi- 
culties  into  the  proofs  that  there  exist  an  optimal  N-period  program  and 
a limit  policy.  The  difficulties  arise  from  the  fact  that  a conditional 
expectation  appears  in  the  dynamic  programming  equation  for  V^iM). 

This  equation  is  V,T,(M)  = max  [ u(x)  + 6E(  V..  , ,(M  - x + y, ) n)]  . 

0«?x$M  i u 

Conditional  expectations  are  defined  only  up  to  sets  of  probability  zero, 
and  there  must  be  a different  such  expectation  for  each  of  the  continuum 
of  possible  values  of  x.  If  the  conditional  expectations  were  not  chosen 
properly,  the  maximizing  value  of  x might  be  undefined.  (The  maxi- 
mizing value  is,  of  course,  a random  variable.  ) 

The  technical  facts  needed  to  deal  with  this  and  related  problems 
are  gathered  in  an  appendix.  With  the  help  of  these  facts,  one  can  adapt 
to  the  context  of  this  paper  Schechtman's  arguments  which  prove  the 
existence  of  optimal  and  limit  policies.  These  adaptations  are  made  in 
sections  4 and  5. 

Yaari  [15)  proves  another  asymptotic  result  bearing  on  the  perma- 
nent income  hypothesis.  He  assumes  that  the  consumer  can  borrow 
freely  and  formulates  the  consumer's  maximization  problem  as  follows. 

" N - 2 

max  E Yj  u<xn)  + U^MN-1^  * 

x0’  • • • > XN-1  Ln=0 


where  Mq  is  given  and  for  n > 0 


M = M . - x , + y . 
n n-1  n-1  Jn 


! 

I 
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Like  Schechtman,  Yaari  assumes  that  the  utility  function  is  determi- 
nistic and  that  the  random  variables  yn  are  independently  and  identi- 
cally distributed.  Yaari's  model  differs  from  Schechtman's  in  that 
u(x)  is  defined  for  all  real  numbers  x and  the  real  variables  xn  are  not 
constrained  to  be  non-negative.  The  only  constraint  is  that  consumption 
spending  in  the  last  period  be  M^_j.  Yaari  proves  that 

lim  x,in(M)  = E y_,  when  xwn(M)  is  the  optimal  consumption  in  the 
N-*°o  NU  u iNU 

first  period  if  the  initial  stock  of  money  is  M.  His  methods  are  simi- 
lar to  Schechtman’.’  in  that  both  use  the  techniques  of  dynamic  program- 
ming. 

Yaari's  theorem  may  be  generalized  to  the  context  of  this  paper. 
That  is,  it  may  be  assumed  that  utility  is  random  and  that  all  random 
variation  is  generated  by  a stationary  process.  The  proofs  are  similar 
to  those  given  here.  As  is  the  case  here,  the  key  arguments  involve 
only  economic  intuition  and  the  strong  law  of  large  numbers. 

The  use  of  stationary  processes  has  appeared  elsewhere  in  eco- 
nomic literature  dealing  with  models  related  to  the  one  studied  here, 
namely,  in  Radner  [12]  and  Mirman  and  Zilcha  [9]  . 

2.  DEFINITIONS,  NOTATION,  AND  THE  MODEL 


; j 


? I 


I 


The  Underlying  Stochastic  Process 

The  stochastic  process  known  to  the  consumer  is 
{un:  n is  an  integer}.  (Doob  [6]  is  the  reference  used  for  stochastic 
processes.)  The  random  variables,  wn,  are  assumed  to  take  their 
values  in  Q-dimensional  Euclidean  space,  R^.  The  underlying  sample 


space  of  the  process  is  assumed  to  be  ft  = -{(...  ,u)  j.Uq.Uj  , . . . ) : 

un  € R^  for  all  n}.  u>  denotes  an  element  of  ft,  and  un  E R^  denotes 
th 

the  n subvector  of  w.  The  measurable  subsets  of  ft  are  denoted  by  if  , 
and  P denotes  the  probability  on  if  is  the  smallest  complete  a-field 
such  that  all  the  random  variables  u are  measurable  with  respect  to  if . 


Sets  if  such  that  P(S)  = 0 are  called  sets  of  probability  zero.  An  event 


occurs  almost  surely  or  for  almost  every  cj  if  it  occurs  for  eve 


except  for  elements  of  a set  of  probability  zero. 

E denotes  the  expectation  operator  corresponding  to  P.  That  is, 

/ X(u)  P(dw). 

If  J is  a sub-o-field  of  if  and  X is  a random  variable  on  ft,  then 
E(x|  T ) denotes  the  expectation  of  X conditional  on  ,T.  That  is,  E(xJt) 


if  X is  a random  variable  defined  on  ft,  EX 


is  a random  variable  on  ft  which  is  measurable  with  respect  to  (F  and 


J X(u)  P(du)  = J E(X|.T)(u)P(du) 


for  all  S E T.  E<x|$)  is  well-defined  if  e|x|  < ».  E(x|.T)  is  not 
uniquely  defined,  but  any  two  versions  of  E(x|;T)  are  equal  almost 
surely.  (See  Doob  [6,  pp.  17-24]  for  a discussion  of  conditional 


probability.  ) 


which  the  random  variables  u,  , k < n,  are  measurable,  if  represents 

k n 

the  information  available  in  period  n,  and  E(  Is^)  is  the  expected 
value  operator  conditional  on  this  information.  For  emphasis,  it  is 
recalled  that  if n may  represent  more  information  than  knowledge 

of  past  values  of  y^  and  u^. 


The  following  are  the  basic  assumptions  made  about  the  stochastic 
process  {^n}. 

2.  1 Assumptions  about  l^nl 

The  stochastic  process  {^n}  is  stationary  and  metrically  transitive. 

Let  t : U -*■  n be  the  shift  operator,  defined  by  the  formula 
(Tu)n  = u j.  {^n}  is  stationary  if  and  only  if  t is  probability  preserving, 
that  is,  P(tS)  = P(S)  = P(t  *S),  for  every  measurable  set  S.  A measur- 
able set  S is  said  to  be  invariant  if  P (S)  = P (SHtS)  = P (rS).  A process 
is  said  to  be  metrically  transitive  if  every  invariant  set  is  of  probability 
zero  or  one. 

Metric  transitivity  is  not  a serious  restriction,  since  every 
process  is  metrically  transitive  when  restricted  to  an  invariant  set. 

Stationary  processes  are  quite  general.  If  the  are  independ- 
ently and  identically  distributed,  then  the  would  form  a stationary 
process.  If  , . . . are  generated  by  a Markov  process  with 

stationary  transition  probabilities,  and  if  Uq  is  distributed  according  to 
a stationary  distribution  for  this  Markov  process,  then  Uq,u^,.  . . form 
a stationary  process.  Every  stationary  process  can  be  represented  as 
a Markov  process  with  random  variables  in  an  infinite  dimensional 
space,  the  space  being  {(...,  , w^)}  . But,  many  stationary  processes 

cannot  be  represented  as  Markov  chains  with  random  variables  belong- 
ing to  a finite  dimensional  vector  space.  Consider,  for  instance,  the 

process  ~ 2j  2 z ^ . where  the  z^  are  independently  and  identi- 
k=-°o 

cally  distributed  and  uniformly  bounded. 


The  realizations  of  a stationary  process  may  be  periodic  functions 
of  n.  For  instance,  let  u and  v be  mutually  independent,  normally 
distributed  random  variables  with  mean  zero  and  variance  one.  Then, 
the  random  variables  = u cos  cm  + v sin  cm  form  a stationary  process 
where  0 < a < 2 ir.  Observe  that  one  can  predict  exactly  the  values  of  un, 
for  n > 1 , from  knowledge  of  Uq  and 

Processes  with  independent  increments  are  not  stationary.  A 
martingale  is  not  a stationary  process. 

Frequent  use  will  be  made  of  the  following  facts. 

2.2  Let  z be  a random  variable  on  £2  and  let  z^iu)  = z(Tnu).  Then, 
the  process  { n an  integer}  is  stationary  and  metrically  transitive 
(Doob  16,  p.  458]  ). 

The  Economic  Model 

2 . 3 Assumptions  About  Incomes 

The  income  received  at  the  end  of  period  n-1  is  a random  variable 
on  £2,  y^:  £2  — ► ( -oo , oo) , which  is  measurable  with  respect  to  S^.  The  yn 
satisfy  the  following: 

i)  yn(w)  = yQ(Tnuj)  , 

ii)  y q(u)  » 0,  for  all  u,  and 

iii)  0 < EyQ  < °o  . 

Observe  that  by  2.2, 

2.4  {y  } f°rms  a stationary,  metrically  transitive  process. 
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y)  will  always  denote  the  Borel  cr-field  on  [ 0,oo)  and  ^ (X)  9 or 
■H  (X) 9^  will  denote  the  product  cr-fields  of  16  and  9 or  4}  hnd  9^, 
respectively.  A function  f = [0,oo)  X £1  — [0,  oo)  will  be  said  to  be 
measurable  if  it  is  measurable  with  respect  to.#  9 . 


2 . 5 Assumptions  About  Utility 

The  consumer's  utility  function  for  period  n,  u : [0,oo)  X £2  -*  [0,oo), 


is  measurable  with  respect  to  9 and  satisfies  the  following . 


i)  u^lx.u)  = Ug(x,Tnu)  for  all  x and  u. 


ii)  Uq(0,w)  = 0 for  all  u. 


iii)  For  every  to,  u^(  • , u)  is  strictly  increasing,  strictly 


concave,  and  continuously  differentiable . u^(x,u) 


will  denote  ^-u^x.w). 


iv)  u^(0,cj)  ^ 1 for  all  u. 


v)  lim  u'(x,u)  = 0 uniformly  in  u. 
x-*oo 


Assumption  ii)  involves  no  loss  of  generality. 


The  assumption  that  un  is  measurable  implies  that  u^  is  measur- 


able, since 


uf  (x,u)  = lim 
n e— 0 


U (x+  E,u)  - U (x,w) 


n 


Hereafter , proofs  that  the  various  functions  appearing  are 
measurable  will  not  be  provided,  since  the  proofs  are  routine. 
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The  Optimization  Problem 

The  statement  of  the  consumer's  optimization  problem  given 
in  the  Introduction,  (1.1),  is  slightly  ambiguous,  for  the  conditional 
expectation,  E(  j 5^),  appearing  in  the  objective  function,  may  be 
defined  only  up  to  a set  of  probability  zero.  Hence,  the  objective 
function  may  not  be  defined  for  every  state  of  the  world,  oj.  For  this 
reason,  the  conditional  expectation  is  replaced  by  an  ordinary  expec- 
tation. 

2 . 6 Problem 

N-l 

max  E J 6nu  (x  ) 

L-‘  n n 

x0’  ' ’ ‘ ,XN-1  n=0 

subject  to:  x is  a random  variable  measurable  with  respect  to  & and 
n n- 1 n 

0 ^ x $ M for  all  n,  where  M = M + V (y.  . , - x.  ) for  all  n and  M 
n n n J k+1  k 

k=0 

is  given. 

It  is  always  assumed  that  0 < 6 ^ 1. 

In  discussing  solutions  of  this  problem,  it  is  necessary  to  require 
that  the  random  variables,  x , depend  in  a measurable  way  on  the  initial 
stock  of  money  M. 

Definition.  A program , X,  is  a finite  or  infinite  sequence  of  functions 

Xn:  [0 , oo)  x — ► 10 , oo),  n = 0,  1 , . . . , where  X^  is  measurable  with 

respect  to  9 . 

Xn<M,u))  is  the  expenditure  in  period  n if  the  state  of  the  world  is  u)  and 
the  stock  of  money  in  period  zero  is  M.  Observe  that  Xn(M,u;)  is  always 


1 


1 

I 
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non-negative.  A program  (Xq,  . . . , XNJ)  will  be  called  an  N- period 
program. 

A program  may  be  described  in  a way  which  makes  current 
expenditures  depend  on  past  expenditures  as  well  as  on  u and  the  initial 
stock  of  money.  But  such  a program  may  be  reduced  easily  to  one 
which  depends  on  u and  the  initial  stock  of  money  only  and  hence  could 
be  described  as  above. 


M ( X , M , u) , n = 0 , 1 , . . . will  denote  the  sequence  of  money 

stocks  generated  by  the  program  X when  the  initial  stock  is  M.  That  is, 
n-  1 

M (X,  M , u)  = M + Y (y.  x1(u)-X,(M,u)). 
n k=0 


Definition.  A program  is  said  to  be  feasible  if  for  every  n, 

X (M,lj)  < M ( X,M,cj ) for  all  M and  cj. 
n ' n 


If  X is  an  N-period  program,  WT,  ..(X,  M , to)  will  denote 

N-l 

y 6nu  (X  (M,u),uj). 

u n n 
n=0 


; 


y 


« 


1 1 





Definition.  An  N-period  program,  X = (Xq,  . . . ,X^_1),  will  be  called 
optimal  if  it  is  feasible  and  if  for  every  M 5*  0,  E WN6(X,M) 


= sup  E W^^(X,M),  where  the  supremum  is  taken  over  feasible  N- 


period  programs. 


Problem  2.6  may  now  be  stated  more  compactly  as  follows. 


Problem 


N-l 


max  E £ <5%  (X  (M)). 
X feasible  n=o 


■ 


It  is  often  more  convenient  to  deal  with  spending  plans  which  make 
expenditure  depend  on  the  current  stock  of  money  rather  than  the  initial 
stock  of  money.  Such  plans  will  be  called  policies. 

Definition.  A policy  x is  a finite  or  infinite  sequence  of  functions 
xn:  [0,  °o)  X ft  — ► t0,»),  n = 0,1,...  such  that  for  each  n,  xn  is 
measurable  with  respect  SP 

A policy  is  said  to  be  feasible  if  xn(M,u)  ^ M for  all  n,  M,  and  u. 

If  x is  a policy,  then  x^M.u)  is  the  expenditure  in  period  n if  the 

current  stock  of  money  is  M.  Policies  will  be  denoted  by  lower  case 

letters,  and  programs  will  be  denoted  by  upper  case  letters. 

A policy  x gives  rise  to  a program  X in  an  obvious  manner. 

Xn(M,u)  = xn(M,u).  Suppose  that  Xn,,..,X  , have  been  defined.  Then, 

0 v)  1 u n i 

M (X,M,u)  = M + Y.  (y.  , -(taJ-X,  (M,u))  is  well-defined  and  one  may  let 

n k=o  k+1  k 

X (M,u)  = x (M  (X,  M , u) , to), 
n n n 

A feasible  N- period  policy  is  said  to  be  optimal  if  the  program  to 
which  it  gives  rise  is  optimal. 

Optimal  Policies  and  the  Limit  Policy 

It  will  be  proved  (Lemma  4.  1)  that  for  every  N and  6 there  exists 
an  optimal  N-period  policy,  xN6  = (xN6Q, . . . >XN6 
XN6  = (XN60’  ‘ • • ,XN6  N-l^  wil1  denote  the  corresponding  N-period 
program.  VN6(M,  . ) will  denote  a version  of  E ( WN6(XN , M)|  .5^) . 

is  (almost  surely)  the  maximum  expected  N-period  payoff  given 
the  information  available  in  period  zero  and  an  initial  stock  of  money  M. 


J 
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It  will  be  proved  (Lemma  4.  1)  that  V^g  may  be  chosen  so  that  for 
almost  every  u,  V^g(M,u)  is  continuously  differentiable  as  a function  of 
M with  the  derivative  bounded  above  by  one.  V^g(M,u)  will  denote  a 
function  which  is  equal  to  V^g(M,u)  whenever  this  derivative  is 
defined. 

In  Lemmas  5.1,  5.  6,  and  5.  10  it  is  proved  that  for  almost  every  cj, 
V^g(M,u)  is  a non-decreasing  function  of  N and  6,  and  xn5q(M,cj)  is  a 
non-increasing  function  of  N and  6,  for  all  M.  Part  iv  of  Assumption  2.5 
implies  that  V^g(M,u)  is  bounded  above  by  one,  so  that  lim  V^g(M,u) 


exists  almost  surely.  Let  X^be  any  function  such  that 


\q(  M , u)  = lirn  V^g(M , u)  whenever  this  limit  exists.  (Then,  is 
N — °o 

measurable  almost  surely.)  For  each  n,  let  Xn(M,u)  = ^Q(M,Tnu). 

Similarly,  x^^M.cj)  denotes  any  function  such  that  0 « x^^M  , u)  ^ M and 
x n(M,w)=  lim  xN(,n(M  , u)  whenever  this  limit  exists . Forn>l,letx  (M,u) 


6-*l 

N-*-°o 


oon 


= x n(M,T  u).  Clearly,  0 ^ x (M,cj)  < M everywhere  and  x is 
oou  J oon  J oon 

measurable  with  respect  to  & (X)  ^ . Hence  ,x  =(x  „,x  .,...)  is  a 

policy,  x^  will  be  called  the  limit  policy  and  the  corresponding  program 

will  be  called  the  limit  program. 

If  6 = 1 , then  the  subscript  for  6 will  be  dropped.  Thus, 

vn(M,u)  = VNi(m,u),  V^(M,uj)  = xNn(M  ,u)  = xNln(M,u), 

and  X^n(M,u)  = X^ln(M,w).  Similarly,  if  0 < 6 < 1 , then 

Vg(M , u)  = lim  VN6(M,uj),  and  Xgn(M,w)=  lim  xN6n(M,u).  X,  will 
N-*°o 

denote  the  program  corresponding  to  the  policy  xfi.  It  will  be  shown 


(Lemma  9.1)  that 


V6(M,u)=e(  f 6nun(X6n(M))k0)(L,) 

n=0 

oo 

»e(  X 6nun(Xn(M))|^0)(u;) 
n=0 

almost  surely  for  all  feasible  programs  X.  That  is,  x^  is  optimal  for 
the  infinite  horizon  problem  with  discounted  utilities,  and  V^(M,  . ) 
gives  the  optimal  expected  total  discounted  utility,  conditional  on  the 
information  available  in  period  zero. 

Policies  With  a Constant  Marginal  Utility  of  Expenditure 

Define  Dq : (0,  lj  X SI  — ► [0,oo)  as  follows.  n^( t,io)  is  the  unique 

value  of  x such  that  t > u^(x,cj)  with  equality  if  x > 0.  p^t.w)  is  the 

quantity  of  money  the  consumer  would  spend  in  period  zero  if  his 

marginal  utility  of  money  were  t and  he  were  not  constrained  by  a lack 

of  money.  Pq( t,u>)  is  well-defined,  for  Uq(x,Cl>)  is  strictly  decreasing  as 

a function  of  x and  lim  Uq(x,u)  = 0.  Clearly,  Pq(1,u)  = 0, 

x-^oo 

lim  r?  ( t , co)  = oo  and  hn(t,cj)  is  continuous  as  a function  of  t.  Also,  if 
t-*0  u u 

tj  > t2  and  Pq( t2,u)  > 0,  then  n^t  ^ , w)  < P0(t2,co).  It  is  very  easy  to  see 

that  J?Q(t,  . ) is  measurable  with  respect  to  for  every  t.  Since 

lim  u'(x,u)  = 0 uniformly  in  cj,  r?  ( t , cj)  is  bounded  and  so 
x-*-oo  u u 

(2.  7)  E i?0<t)  < oo  for  all  t. 

Er?0(l)  = 0 and  by  the  monotone  convergence  theorem  (Lo&ve  [8,  p.  124]), 


WK 
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(2.8)  If  t1  > t and  E rj  (t2)  > 0,  then  E i7Q(t1)  < E i7Q(t2). 


If  t <E  (0, 1]  for  n = 0, 1 ,2, . . . and  limt  = tn>  then  r?Jt  , w)  converges 
n _ ^ n u u n 

11  n-*oc 

to  nQ(tQ,(j)  for  all  u and  0 « nQ(tn,u)  ^ tk,u)  < oo  for  all  n and  u. 

It  follows  from  the  Lebesque  dominated  convergence  theorem  (Loeve 

[8,  p.  125])  that  lim  E nQ(tn)  = E rj  (tQ).  Hence, 
n-*-oo 


(2.9) 


E p (t)  is  a continuous  function  of  t. 


In  conclusion,  one  obtains  the  following. 


(2.10)  The 


There  exists  a unique  value  of  t,  X,  such  that 
Ei70(M=Ey0.  0 < X < 1. 


It  will  be  proved  that  X is  the  asymptotic  value  of  the  marginal 
utility  of  money. 

rj  ( t,u)  will  denote  nQ(t , Tnw).  ( PQ(t) , rjjt  t) , . . . ) forms  a program 
(and  also  a policy)  which  will  be  denoted  by  n( t).  This  program  keeps 
the  marginal  utility  of  expenditure  equal  to  t.  h(t)  is  not  necessarily 
feasible. 


3.  THEOREMS 


3.  1 Main  Theorem 


For  almost  every  u,  Xq(M,gj)  » X for  all  M ^ 0 and 

lim  Xn( M , u)  = X. 

M^oo 


3. 2 Theorem 

For  almost  every  w,  the  following  is  true  for  every  initial  stock  of  money . 
lim  X (M  (X  ,M,u),u)  = X. 

n n'  oo' 

n-*°o 
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It  may  be  said  that  X is  optimal  in  the  limit  average  sense  if 


N-l  N-l 

(3.3)  lim^-E  Yj  un(XQon(M))  = sup  lim  inf  ^ E £ un(Xn(M))  , 


N-oo  " n=0  “ X N-oo  - n=0 

where  the  supremum  is  taken  over  feasible  policies  , X. 


Observe  that 


N-l  N-l 

sup  lim  inf  ^ E ) u (X  (M))  < Km  inf  sup  j-r  E Y u (X  (M)) 
X N-oo  n=0  N-oo  X n=0 


- lim  inf  ^-E  Vn(M). 
N -*  oo 


Therefore,  to  say  that 
N-l 


lim^E  l un(X„n(M))-  lim  1EVn(M) 
N-*-oo  n=0 


N- 


is  a stronger  assertion  about  the  optimality  of  X than  is  (3.3).  Hence, 


the  following  theorem  asserts  that  X^  is  optimal  in  a limit  average  sense. 


3.4  Theorem 


N-l 


N 


kE  l un(X«n(M»  - “m  5fVN(M> 


n=0 


N- 


More  generally,  the  following  is  true. 


3.  5 Theorem 


For  almost  every  u,  the  following  equalities  hold  for  all  M: 
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= lim  V 6%  (X  n(M,u),u) 

c , 6 U n oon 


= lim  |:E  y u (X  (M)) 
N O n oon 

N-*°°  n=0 


= y 6nEu(X  (M)) 

P . 6 ^ n oon 


E uQ(rj0(  )) 


= lim  1 


E VX1(M) 


N-oo  N N 


lim  E V,(M) 

6-*  1 6 6 


lim  ^ VN(M  ,u) 
N-*-oo 


lim  V,(M.u) 

6-1  6 6 


4.  THE  OPTIMAL  N-PERIOD  PROGRAM 

The  proofs  given  in  this  section  and  the  following  one  are  brief, 
for  they  are,  for  the  most  part,  simply  modifications  of  arguments 
given  by  Schechtman  [14,  section  1], 


4.  1 Lemma 


There  exist  measurable  functions 


VN6: 

l0,oo)  x a — ► 

[0 , oo) , 

qN  6 : 

l0,oo)  Xil- 

[0 , oo ) , and 

XN6n: 

[o.oo)  xn- 

[0  , oo) , 

for  n 

= 0,1,.  . . .N-l 

and  N = 1 , 

2. 

. . . , and  0 < 6 ^ 1 , 

which  satisfy  the  following. 

i) 

XN6  (xN60'-’ 

• *XN6,N-1) 

is 

an  optimal  N- period 

xN6n(M’w)  =XN 

-n  , 60^M  ’ T" 

u) 

for  all  n. 

ii) 

For  every  M ^ 

0,  vN6(M. 

. ) 

is  a version  of 

iii) 


iv) 


N-l 


E(  l S\^K6nW)>^o)  ■ where  XN6  is  the  program 
n=0 


corresponding  to  the  policy  x^. 

If  M:  & — * [0,oo)  is  measurable  with  respect  to  and  if 


X is  any  N- period  policy,  then 
N-l 

VN6(M(cj),cj)  > e(  7^  6nun(Xn(M))|^0J  (w)  almost  surely. 


n=0 


For  almost  every  u,  VNA(M,u)  and  are  continu- 


ously differentiable  as  functions  of  M.  The  derivatives 
are  positive,  less  than  or  equal  to  one,  and  strictly 
decreasing. 


V^6(M,u)  and  q^(M,u)  denote  any  functions  equal  to 
^VN6(M,cj)  and  ^-qN6(M,u)  whenever  these  derivatives 
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]Vn6(M,cj)  denotes  VN6(M,tu)  and 
denotes  V^6(M,tw). 

v)  qN5(M,.)  = E(1VN5(M+y1)|i'0)  and 

q^6(M,  . ) - E<1VJJ6<M+y1|i'0),  for  all  M. 

vi)  For  almost  every  u,  xN6Q(M,(j)  solvesthe  problem 

max  [un(x,u)  + 6qN  , (M-x,u)]  , for  all  N , 6 , and  M. 

O^x^M  U 

vii)  For  almost  every  u, 

VN+1,6<M'u)®  61N6(M-!‘NM160<M'“)’U)  f°r  311  M- 
with  equality  if  M - xN+1>60(M,1j)  > °‘ 

viii)  For  almost  every  u,  * u0(xN60(M*u)-w) 

for  all  M,  with  equality  if  xN6q(M,uj)  > 0. 

ix)  For  almost  every  u,  x^T  6 q(  M , to)  and  M-xN{Q(M,u) 
are  continuous,  non-decreasing  functions  of  M. 

Proof 

The  proof  proceeds  by  induction  on  N. 

For  N=l,  let  xI60(M,u)  = M and  VJ6(M  ,u)  = uQ(M  ,w).  x16Q  and 

V16  clearly  satisfy  conditions  (i)-(iv),  (viii),  and  (ix)  of  the  lemma. 

Applying  Lemma  A.  3 with  Q(M,u)  = 1V16(M4y1(w),u)  = u1(M+y1(u),u), 

one  obtains  q,t  which  satisfies  conditions  (iv)  and  (v).  This  completes 
16 

the  first  step  of  the  induction. 


- 


have  been  defined 


Suppose  that  N > 1 and  that  q^6  and  x^6n 

for  k < N and  satisfy  the  conditions  of  the  lemma. 

By  condition  (iv)  of  the  lemma  and  the  assumed  properties  of  Ug, 

for  almost  every  to  the  following  problem  has  a unique  solution  for  each  M. 

max  [u  (x,to)  + 6qw  . (M-x,to)]. 

0«x«M  u 

Let  [0,oo)  X i2  — [0,«>)  be  any  function  such  that  0 < x^^g(M,u)  ^ M 

and  x^£q(M,u)  solves  the  above  problem  whenever  the  problem  has  a 
solution.  It  is  easy  to  show  that  x^g  is  measurable  with  respect  to  (X)  SP . 
If  1 ^n=e  N-l,  let  xN6n(M,u)  = xN_n  6Q(  M , rnu).  Clearly,  xNfi  is  a 
feasible  policy. 

Let  VN6(M  ,cj)  = Ug(xN6Q(M  ,u),uj)  + 6qN-1  6(M-xN6g( M , to) , to).  Since 

qN-l  6^M”xN60^M’  . ) is  a version  of  ^(M-  xN60(M)+yl)^0) 

by  the  induction  hypothesis,  it  follows  that  . ) is  a version  of 

e(  Z 6"u  (XNJn(M))k0)  . 
n=0 

It  is  now  proved  that  satisfies  condition  (iii).  Let 
M:  ft  — ► [0,oo)  be  measurable  with  respect  to  S^g  and  let  X be  any  feasible 
N- period  program.  By  condition  (iii)  applied  to 

N-l 

1VN-1  6<M(U)-X^M(U).U)  + yi(U).U)>E(  l 6n  un(Xn(M)|^Q)(uj) 

n = 1 

almost  surely.  By  condition  (v)  and  Lemma  A.  4, 

qN-l,6(M(y)'X0(M(lj)’w)’tj)  = E(lVN-l,6(M  “X0(M)+yl)lyo)(u)- 
Hence, 

N-l 

qN.j  6(M(u)-Xg(M(u),u).u)  ^ e(  £ 6n-1un(Xn(M))|  S'g)  (to) 


almost  surely. 


It  follows  that 


E(  E 6nun(Xn(M))|^o)(uj) 

n=0 

« u0(X0(M(u),u),u)  + 6qN-1  fi(M(uj)  - XQ(M(u) , u) , u) 

< u0(Xn0(M(u),u),cj)  + 6qN_1  6(M(u)  - XN60(M(u),u)) 

= VN6(M(u),u) 

almost  surely,  where  is  the  program  associated  with  the  policy  x^ 
The  second  inequality  follows  from  the  definition  of  X^p.  This 
completes  the  proof  that  satisfies  (iii). 

Clearly,  (iii)  implies  that  x^  is  an  optimal  N-period  policy. 

It  follows  from  elementary  calculus  and  the  definition  of  x^p  that 
XN60  anc^  ^N6  satisfy  conditions  (iv),  (vi)-(viii).  Again  by  elementary 
calculus,  for  almost  every  u,  x^(5q(M  , u>)  and  M - x^pl  M , u)  are  non- 
decreasing functions  of  M.  Since  the  sum  of  these  functions  is  M,  it 
follows  that  x^,6q(M,u)  is  Lipschitz  with  constant  1 and  hence  continuous 
(This  argument  is  borrowed  from  Brock  and  Mirman  [ 5,  p.  490  ) . ) 

This  proves  (ix). 

By  Lemma  A.  3 applied  to  the  function  V^AM  +y1(u),Tuj),  there 


m—j  milium  i i w iV/U  t w tuv  iuuoi  iwii  v 1*1  ■ j ^ \ 

exists  a function  qN,.  satisfying  conditions  (iv)  and  (v). 


5.  THE  LIMIT  PROGRAM 


Q.E. D. 


In  order  to  avoid 


problems  with  sets  of  measure  zero,  from 


now  on  it  will  be  assumed  that  6 is  restricted  to  the  following  countable 
set  { 6 | 0 < 6 ^ 1,  6 is  rational}  . 
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5.  1 Lemma 

For  almost  every  u,  V^g(M,u)  is  a non-decreasing  function  of  N 
for  all  M. 


Proof 

In  what  follows,  it  will  be  assumed  that  u is  such  that  the  following 
are  true  for  all  N,  6,  and  M: 


(5.2) 


(5.  3) 


V^6(M,gj)  ? Uq(xN60<M,<j),cj),  with  equality  if 
xN60(M  ,u)  > 0 and 


VN+1,6(M,w)  ? qN6(M  “XN+1,60 
M ‘ xN+l,60(M'u)  > °' 


(M,w),u),  with  equality  if 


By  Lemma  4.  1,  almost  every  to  satisfies  the  above. 

The  lemma  will  be  proved  by  proving  that  almost  surely  both 
V^.6(M,u)  and  q^(M,u)  are  non-decreasing  functions  of  N for  all  M. 
The  proof  is  by  induction  on  N,  for  N » 2. 

Suppose  N = 2.  By  (5.2), 


V^M.u)  = u'0(x2S0(M,u),u)  3*  Uq(M  ,u)  = Vr16(M,u),  for  all  M. 
It  is  next  shown  that 

(5.4)  for  almost  every  u,  q^M.u)  3 q^g(M,uj)  for  all  M. 


By  what  has  just  been  shown,  for  each  M 


I 


Suppose  that  N > 2 and  it  has  been  shown  that  for  almost  every  cj, 
V^6(M,cj)  and  q^M.u)  are  non-decreasing  functions  of  k for  all  M 
and  for  k < N.  It  will  now  be  assumed  that  u satisfies  the  following  as 
well  as  (5.2)  and  (5.3). 

(5.  5)  6(M.u)  is  a non-decreasing  function  of  k 

for  all  M and  for  k < N. 

It  is  now  proved  that  V^6(M,u>)  > v^-i  for  all  M. 

Suppose  that  xN60(M,u)  > 0.  Then , xN6Q(M  , u)  « xN1  60(M.u). 
For  if  xN6Q(M  ,u)  > xN1  6Q(M , u),  then  by  ( 5.  2),  (5.3),  and  (5.5) 

U(/  XN-1 , 60^  ’ > U(/XN60^  ’ ~ 

^ 6qN-l  ,6^M-XN60^M,U)^U^  ^ 6qN-2)6(M~xN60(M,U*’lj) 

> 64-2,6(M‘XN-1,60(M'u)'u)- 
This  implies  that  ^q(  M , u)  = M,  which  is  impossible. 

Since  xN_j  60(M,u)  3>  xN60(M,uj)  > 0, 

~ U0^XN60^  ’ ^ ? U0^XN-1 , 60^  ’ ^ = ^N-1,6^’**^' 

as  is  to  be  proved. 

Suppose  now  that  *N60(M<U>  = 0.  If  xN-1  50(M,u)  > 0,  then 
VN-1,6(M>ij)  = u0(xN-1,60(M,u),u))  < Uq(°,cj)  < V^6(M,u).  If 


. 


wmm 
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XN  1 = 0 as  we^  and  ^ > tben  ^N-l  qN-2,6^’U^ 

<:  q'  ,(M  ui)  = V'  ,(M,u).  This  completes  the  proof  that  V^6(M,u) 
MN~1 ,6  ' IN  , o 

2>  V^_x  6(M,u)  if  M>0.  Since  V^6(  . ,u)  and  V^_x  6<  . ,w)  are  continuous 
almost  surely,  V^6(0,w)  > 6<0,u>  almost  surely. 

This  completes  the  proof  that  for  almost  every  u,  V^6(M,u) 

? V'  6(M,u)  for  all  M. 

The  argument  that  proves  (5.4)  proves  that  for  almost  every  u, 

qN<M.“>®  WM."»forallM'  Q.E.D. 

5.  6 Lemma 

For  almost  every  w,  Vj^M.u)  is  a non-decreasing  function  of  6 
for  all  M. 


Proof 

By  Lemma  4.1,  it  may  be  assumed  that  u is  such  that  the  following 
are  true  for  all  N , 6,  and  M. 

(5.7)  VN6(M’u)  and  qN6(M,w)  are  differentiable 

and  strictly  concave. 

( 5.  8)  VN6(M,u)  = u0(xn6(M,w),w)  + 6qN_16<M  * XN60(  M ■ ’ u)> 


(5.9)  xN60(M,w)  solves  the  Problem 

max  [un(x, uj)  + 6q~_^  ^(M-x.w)]. 
0^x«M 


It  is  now  proved  by  induction  on  N that  for  almost  every  u, 
V^6(M,u)  and  q^6(M,w)  are  non-decreasing  functions  of  6 for  all 

N and  M . 


t 

J 
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If  N = 1 , there  is  nothing  to  prove  since  Vj6(M,u)  - Uj(M,u)  and 
q'16(M,u)  = EIu'^M+y^l^Ku))  do  not  depend  on  6. 

Suppose  by  induction  that  almost  surely  ^(M.u)  is  non- 

decreasing in  6 for  all  M.  From  (5.  7) -(5.  9)  it  follows  by  elementary 
calculus  that  almost  surely  ,u)  is  non-decreasing  in  6.  Since 

q^6(M,u)  = EljV^lM+y^l^Ku),  if  follows  (using  Lemma  A. 6)  that 
for  almost  every  u,  q^6(M,u)  is  a non-decreasing  function  of  6 for 
all  M. 

Q.E.  D. 

5.  10  Lemma 

For  almost  every  u,  x^6q(M,u)  is  a non-increasing  function  of 
N and  6 for  all  M. 

Proof 

This  lemma  follows  immediately  from  the  previous  two  and  the 
fact  that  almost  surely,  V'  (M,w)  > U(/XN60(  M , u) , u)  for  all  M with 
equality  if  x^6q(M  ,oj)>  0. 

Q.E. D. 


Recall  that  X„  and  x „ are  defined  to  be  functions  such  that 
0 oo  U 

for  almost  every  u,  UM,u)  = lim  V'  ,(M,u)  and  x _(M,u) 

0 n— ^ 00  u 


= lim  xN60(M,u)  for  all  M > 0.  Also,  Xn(M,u)  = Xq(M,t  u)  and 
N— oo 
6-1 

x (M,u)  = x JM,Tnu>).  The  following  lemma  says  that  X gives  the 

oo  n oo  U n 

marginal  utility  of  money  in  period  n consistent  with  use  of  the  limit 
policy  Xoo  =(xoo0,xcol,...  ). 


*#• 


5.11  Lemma 


For  almost  every  u,  X.  (M,u)  » u^x^M  , u) , co)  with  equality  if 

x (M,u)>  0 for  n = 0,1,...  and  for  all  M. 
oon 

Proof 

Since  \ (M,u)  = and  u^x^iM , u) , u)  = ^(x^M , Aj),  Tnij) , 

it  is  sufficient  to  prove  the  lemma  for  n = 0. 

By  Lemma  4.1,  for  almost  every  u,  V^j6(M,l>)  * U0(XN60(M’U)’UJ) 
for  all  M and  N with  equality  if  xN60(M,u)  > 0.  Since  ujj(M,u)  is  a 
continuous  function  of  M , it  follows  that 

(5.  12)  for  almost  every  u, 

X.(M,u)  = lim  V'  (M,u)»  lim  u[j(xN60(M,u),(j) 
u N-*oo  N-*°° 

6-1  6-1 

= uJjtx^fM.u),!!)),  for  all  M. 

If  x JM  u)  > 0,  x,t.JM,u)  > 0 for  all  N and  6 so  that  one  has  equality 
ooO  ’ INI  o U 

throughout  (5.  12). 

Q.E. D. 


6.  THE  ERGODIC  THEOREM 

In  this  section,  a precise  statement  is  made  of  the  strong  law  of 
large  numbers  or  ergodic  theorem  for  stationary  processes  and  also 
of  all  the  applications  of  this  theorem  made  in  this  paper. 


Ergodic  Theorem  (Doob[6,  p.  465]) 

Let  z , n = 0, 1 ,2 , . . . be  a stationary  metrically  transitive 
stochastic  process  with  e|  z_|  < °°.  Then,  lim  — (Zg+.  • • + zn-l^  = ^ ZC 

n-»oo  1 

almost  surely. 

Recall  the  definition  of  the  program  >7(t)  = ( OqU),  >L(t), . . . ) givei 
at  the  end  of  section  2.  Let  MN(  h(t) , M , u)  be  as  in  section  2,  that  is, 

N-l 

M (n(t),M,u)  = M + V (y  +1(w)-nn(t,w)). 

n=0 

By  (2.2),  { bn(t , u)}  forms  a stationary  and  metrically  transitive 
process.  By  (2.  7),  e|  nQ(t)  | < «>.  By  (2 . 4),  { yn  } is  a stationary  and 
metrically  transitive  process.  Therefore,  by  the  ergodic  theorem 


(6.  1)  for  all  M 5s  0, 


lim  MN(>7(t),M,u)  = E(yQ-  ^(t))  almost  surely. 
N-*-°o 


By  (2 . 8)  - ( 2 . 10), 

(6.2)  E(yQ~np(t))  is  a non-increasing,  continuous  function  of  t, 

for  0 < t < 1 , and  E (yQ-  OqU))  = 0 if  and  only  if  t = X.. 

Consequently, 


(6.3)  for  all  M ? 0, 


lim  MN(n(t),  M ,w)  = °°  almost  surely  if  t > X , 

N-oO 

lim  MN(n(t),M  , u)  = -<*>  almost  surely  if  t < X.  , and 
lim  ^ Mn(i?(X),M,u)  = 0 almost  surely. 


-*00 
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It  will  be  necessary  to  use  the  fact  that 

(6.4)  if  t > X.,  then 


lim  [ M ( rj(t) , 0 , u)  - ri  7(  h ( t) , u)]  = oo  almost  surely. 


N-^oo 


(6.4)  follows  from  the  obvious  fact  that 


1 , ^ ui 

N t ^ (t) , 0 , u)  - r)^(  rj  ( t) , w)]  = ^ ^ y^iw)-  ^ b^(  h (t),  u) 

_n=l  n=0 

converges  almost  surely  to  the  positive  number  E(y0~  hQ(t)). 


The  ergodic  theorem  also  implies  that 


-i 

(6.5)  lim  y un(hn(t,  w),  u)  = E Uq(  h^it))  almost  surely  for  all  t. 


7.  PROOF  OF  THE  MAIN  THEOREM 


The  proof  of  the  main  theorem  is  broken  up  into  two  lemmas.  The 
economic  intuition  underlying  the  argument  is  explained  in  the  course  of 
proving  the  lemmas. 

Recall  that  VN  - VN],  VJ,  - V^,  ^ - xN]n  and  XNn  = XN,n. 
That  is,  V^,  etc.  correspond  to  the  N-horizon  problem  with  no 
discounting  of  utility.  This  notation  will  be  used  frequently  in  the  next 
two  sections. 

7.  1 Lemma 


For  almost  every  u,  XQ(M,u)  X for  all  M. 
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Proof 

By  Lemma  4.1,  V^M.u)  is  concave  as  a function  of  M almost 
surely,  so  that  » VN<M+l,w)  - VN(M.u).  Since 

X.  (M,u)  = lim  V'  (M,u>),  it  is  sufficient  to  prove  the  following. 

0 ’ TVT  ^ ^ 


i 


Km* 


(7.2)  Given  e > 0,  for  almost  every  u 

lim  sup  [VN(M+l,u)-  Vn(M,u)]  >\-t  for  all  M. 

N -►  oo 

The  following  is  proved. 

(7.  3)  Given  e > 0,  there  exists  a program  such  that  for  each  M, 
E(Wn(Xn,M+1)|^0)(u)-  Vn(M,u)  ^ X - e - 6n(M,u) 

almost  surely,  where  the  functions  6N  are  measurable  and  are 

such  that  for  almost  every  u,  1)  6^(M,u)  is  continuous  from  the 

right  as  a function  of  M and  2)  lim  = 0. 

N -*■<*> 

Clearly,  VN(M+l,u)  » E ( WN(XN  , M +1)|  S^Ku)  almost  surely. 
Since  almost  surely  V^(M  + l,ui)  and  6^(M,u)  are  continuous  from  the 
right  as  functions  of  M , it  follows  from  Lemma  A.  6 and  (7.3)  that  for 
almost  every  u,  V^+^(M  +l,u)-  > X - e - S^OVI.u)  for  all  M. 

Hence , (7.2)  follows  from  (7.3). 

The  idea  of  the  proof  of  (7.  3)  is  as  follows.  Suppose  that  the 
consumer  has  M +1  units  of  money  initially.  X^  treats  one  unit  of 
money  as  extra  money  to  be  spent  at  an  opportune  time.  Xj^  requires 
the  consumer  to  follow  his  optimal  N-period  program  with  initial  stock 


r 


i 

i 


- 39  - 


M until  the  marginal  utility  of  expenditure  exceeds  X - e.  He  then  spends 
as  much  of  his  extra  money  as  he  can  without  bringing  the  marginal 
utility  of  expenditure  below  X-  e.  He  continues  in  this  way  until  he 
spends  all  his  extra  money  or  reaches  the  last  period.  If  he  spends  all 
his  extra  money  before  the  last  period,  he  will  increase  his  total  utility 
by  at  least  X-  e.  If  he  reaches  the  last  period  without  having  spent  all 
the  extra  money,  then  the  marginal  utility  of  expenditure  must  always 
have  been  at  most  X-  e.  This  implies  that  he  will  have  spent  at  least  as 
much  as  he  would  have  if  he  had  followed  the  program  17 ( X — e)  described 
in  the  previous  section.  By  (6.  3),  the  stock  of  money  left  by  this  policy, 
MN_i<n(X-e),M+l.u,).  converges  to  minus  infinity  almost  surely.  Since 
the  consumer  can  never  let  the  stock  of  money  become  negative,  it  is 
very  unlikely  that  if  N is  large,  the  consumer  could  reach  period  N-l 
without  having  spent  the  extra  unit  of  money. 

This  argument  is  now  made  precise. 

X^n  is  defined  by  induction  on  n as  follows. 

(i)  If  ur0(XN0(M,cj),u)  « X - e,  then 

XN0(M+1,cj)  = Xno(M,cj). 

(ii)  If  uq(Xnq(M  ,u),uj)  > X - e,  then 

Xno(m  + 1 . = min(XN0(M,w)  + 1 , r?0(X-e,  <j)). 

Suppose  that  X^  has  been  defined  for  k < n and  that  n > 0. 

(iii)  If  u^(XNn(M  ,u),u)  « X - e,  then 


X^JM+l.u)  = X*, 
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(iv)  If  u^(XNn(M  ,u),u)  > X - e,  then 

XNn(M+l,uj)  = min(xNn(M,u)+Mn(XN,M+l)u) 

- Mn(XN,M,(j),rjn(  X-  e,u>)  . 

The  following  facts  are  immediate  consequences  of  the  definition 
ofXN. 

Mn(XN,M+l,u)  > Mn(XN,M,u)  for  all  n. 

(7.4)  If  u is  such  that  ^(X^  , M+l , uj)  = ^(X^ , M , u) , then 

Wn(Xn,M+1,«j)  - Wn(Xn,M,u)  » X - e. 

(7.5)  If  u is  such  that  M^_  ^(X^  , M + l , cj)  > ^(X^  , M , u),  then 

ur ( Xx,  (M  , u),u)  ^ X - e for  all  n < N-l , so  that 
n Nn  ’ 

XNT  (M  + l ,o  ' > n (X-  e.u)  for  all  n < N-l. 

Nn  n 

(7.5)  implies  that 

(7.6)  If  u is  such  that  M^_  j( X^ , M+l , cj)  > M^^X^, , M , u) , then 

0 ^ Mn_1(Xn,M  + 1 ,u)  * MN_1(rj(X-e),M+l,uj). 

Let  f^IM.u)  be  the  indicator  function  of  the  set 
Sn(M)  = { u|  MN_1(r)(X-e),M+l  ,u)  ^ 0}  . That  is, 

l , if  ue  VM) 

fN(M,u)  = ■ 

0 , otherwise. 


It  follows  from  (7.4)  and  (7.6)  that 

(7.  7)  Wn(Xn,M+1,u)  - Wn(Xn>M,u)  » (X-e)(l-fN(M,u)). 

Applying  E(  \&q>  to  both  sides  of  (7.  7),  one  obtains 

(7.8)  E(WN(XN,M+l)|y0)(u)- Vn(M,w)  » X-  e - (X- e) E(fN(M)|  S^Hu) 

almost  surely. 

Observe  that  for  every  u,  f^(M,u)  is  continuous  from  the  right 

and  non-decreasing  as  a function  of  M.  Also,  since 

lim  M,.(  q (X- e) , M+l , u)  = almost  surely,  lim  fN( M , to)  = 0 almost 
N—  oo  w N— oo 

surely  for  every  M.  Hence,  by  Lemma  A.  5,  there  exists  a sequence  of 
measurable  functions  6^(M,<o)  which  satisfy  the  following  conditions. 

(i)  6n(M,  . ) = (X-e)E(fN(M)|^Q)  for  all  M. 

(ii)  For  almost  every  to,  6^(M,u)  is  continuous  from  the  right  as  a 
function  of  M. 

(iii)  For  almost  every  to,  lim  6„(M,u)  = 0 for  all  M. 

N— * oo 

By  ( i)  and  (7.8), 

E(Wn(Xn,M+1)|^0)(u)  - Vn(M,u)  » X-  c- 6N(M,to)  almost  surely. 
This  completes  the  proof  of  (7.  3). 

Q.E.D. 

7. 9 Lemma 

lim  X.n(M,io)  5 \ almost  surely. 
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Proof 

By  the  almost  sure  concavity  of  V^M.u),  for  almost  every  u, 

V^(M,u)  Vn(M,u)-  Vn(M-1,u)  for  all  M 5*  1.  Since  almost  surely 

X (M,w)  * lim  V'  (M,u)  for  all  M,  it  follows  that  for  almost  every  u, 

0 N-*°°  N 

Xq(M,oj)  « lim  inf  [Vn(M,u)- Vn(M-1,u)]  for  all  M ^ 1 . Therefore, 

N -*•  °o 

it  is  sufficient  to  prove  the  following. 

(7.  10)  Given  e > 0,  for  almost  every  u 

Vn(M,oj)  - Vn(M-1,u)  « X + e + 6(M,u) 
for  all  M ^ 1 and  for  all  N,  where 
lim  6(M,u)  = 0 almost  surely. 

M~*oo 

The  following  will  be  proved. 

(7.  11)  Given  e > 0,  there  exists  a feasible  policy  such  that 

for  each  M ^ 1 

Vn(M,u)  - E(Wn(Xn>M-1)|^0Ku)  * X + e+  6(M,u) 

almost  surely  and  for  all  N,  where  for  almost  every  u 

lim  6(M,w)  = 0 and  6(M,u)  is  continuous  from  the  left 
M-*oo 

as  a function  of  M. 

Clearly,  VN(M-1,  . ) > E ( WN(XN  , M-  1 )|  £fQ)  almost  surely.  Hence, 

(7.11)  implies  that 

(7.12)  For  each  M » 1 , V^(M  , u)  - V^(M- 1 , u)  ^ X + e + 6(M  , w) 


almost  surely  for  all  N. 
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Since  for  almost  every  u,  the  functions  V^(  M , w)  - V^(  M-  1 , u)  and  6(M  ,u>) 
are  continuous  from  the  left  as  functions  of  M , it  follows  from  (7.  12) 
and  Lemma  A.  6 that  for  almost  every  u,  VN(M,u)  - VN(M-l,u) 

< X + e + 6(M  , u>)  for  all  M ^ 1 and  for  all  N . That  is , (7.11)  implies 
(7.  10). 

The  idea  of  the  proof  of  (7.  11)  is  quite  similar  to  that  of  (7.3). 

The  object  of  X^  is  to  enable  the  consumer  to  give  up  one  unit  of  money 
while  losing  no  more  than  X + e + 6(M)  units  of  utility,  where  M is  the 

initial  stock  of  money  and  where  lim  6(M)  = 0. 

M-»-oo 

X instructs  the  consumer  to  reduce  his  expenditure,  if  possible, 
only  when  the  marginal  utility  of  money  is  less  than  X+e.  If  he  spends 
less  only  at  such  times  , he  gives  up  no  more  than  X + e units  of  utility. 
The  consumer  could  be  prevented  from  waiting  for  times  of  low 
marginal  utility  of  expenditure  only  if  lack  of  money  or  arrival  of  the 
final  time  period  forced  him  to  spend  less.  Let  n be  a period  in  which 
he  is  forced  to  spend  less.  In  period  n,  he  spends  all  his 

money.  Also,  his  expenditure  in  this  period  is  at  most  r)n(X  + e,u). 
Otherwise,  he  would  not  be  losing  utility  in  period  n at  a rate  greater 
than  X+e  units  per  dollar.  In  the  periods  preceding  n,  the  marginal 
utility  of  expenditure  must  be  at  least  X + e,  so  that  expenditure  in  these 
periods  does  not  exceed  that  prescribed  by  the  program  rj(X  + e).  Hence, 
his  stock  of  money  in  period  n is  at  least  M^(  rj  ( X + e) , M- 1 , w)  and 
Mn(r)(X  + e),M-l,u)  $ r)n(X  + e,u). 

Observe  that  no  matter  what  happens,  the  consumer  gives  up  no 
more  than  one  unit  of  utility,  since  the  marginal  utility  of  expenditure 
is  bounded  above  by  one. 


In  conclusion,  either  the  consumer  gives  up  X + e units  of  utility 


or  he  gives  up  at  most  one  unit  of  utility  and  an  event  occurs , the 
probability  of  which  is  at  most 

6(M)  = Prob{  inf  [M  ( p ( X+e) , M- 1 , u)  - p (X+e)]  ^ 0} 

l«n<oo  n n 

That  is,  the  consumer's  loss  is  dominated  by  X + e + 6(M). 

Since  by  (6. 4),  lim  [ Mn<  pi  X+e) , M - 1 , w)  - p ( X+e,  u)]  = 00  almost 
n-*-°° 

surely,  it  follows  easily  that  lim  6(M)  = 0. 

M-*-oo 

This  argument  is  now  made  precise. 

X^n  is  defined  below  by  induction  on  n.  It  may  be  assumed  that 
M » 1. 

(i)  If  uq(Xn0(M  ,u),cj)  <5  X + e,  let 
Xnq(M-1,cj)  = min(XN()(M  ,u),M-l). 

(ii)  If  uyXN0(M,(j),u)  < X + e,  let 

Xno(M-  1 ,u)  = min  {max  [Xnq(M,cj)-  1 , p0(  X+e , u)]  ,M-l}. 

Suppose  that  X^  has  been  defined  for  k < n and  n > 0.  Then, 
Mn^XN  ’ 1 is  defined-  ^ maybe  assumed  that  Mn(XN,M-l,u) 

* Mn(Xn,M,u). 

(iii)  If  Mn(XN,M-l,w)  = Mn(XN,M,u,),  let 
X^M-l.u)  = Xn(M,w). 

Suppose  that  Mn(XN  , M- 1 , u)  < Mn(XN,M,w). 

(iv)  If  u^X^dVL.uJ.u)  » X + e,  let 

M-  1 , u)  = min(XNn(M,u),Mn(XN,M-l  ,u)), 


I M t. 


(v)  If  u'(XNn(M,u),u)  <\  + t,  let 


XNr/M~1’U^  = minjmax  [ XNn<M  ,u)-  Mn(XN,M,u) 
+ Mn(XN,M-l,u)  .nj^+e.u)  ],Mn(XN,M-l,<j)} 


The  following  facts  should  be  clear. 


Mn(XN,M-l,u)  « Mn(XN,M,u)). 


(7.13)  If  Mn(XN,M-l,<j)  = Mn(XN,M,u),  then 

Mk(XN,M-l,u)  = Mk(XN,M,u)  for  k > n. 


(7.14)  If  Mn(XN,M-l,w)  < Mn(XN,M,w)  and 

XNn( M- 1 , <jj)  > r?n(  X + e , w) , then 
Mk(XN,M-l,u)  = Mk(XN,M,u)  for  k > n. 


Define  k(M , u)  as  follows.  If  for  some  integer  n = 0,l,...,N-l, 

M (X., , M-  1 , u)  < M (X,,  ,M,u)  and  M (X,, , M- 1 , u)  < n (X  + e,  u),  let 
n in  n in  n in  n 

k(M,u)  be  the  smallest  such  integer.  Otherwise,  let  k(M,u)  = °o. 
k(M,w)  is,  roughly  speaking,  the  first  period  in  which  the  consumer 
could  be  forced  to  spend  less  at  a time  of  high  marginal  utility  of 
expenditure. 

It  follows  immediately  from  the  definition  of  k(M,u)  and  from 
(7.  13)  that  if  k(M,u)  < oe,  then  Mn(XN,M-l,w)  < IVyXj^M.u),  for  all 
n^k(M.u).  Consequently,  by  ( 7.  14)  and  the  definition  of  k(M  , w), 
XNn(M-l  ,u)  s?  hn(k  + e,u)  for  all  n < k(M  ,u),  and  so 

Mk(M,u)(r?<^+e)’M~1,U,)  $ Mk(M,(j)(XN’M_1,w)  ^ ^k(M  ,uj)^+ 
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In  summary. 


(7.15)  if  k(M  ,u)  < then 


Mk(M.u>(r,(X  + c)'M’1*u)  ' rIk(MJu)(X  + E'u)  * °- 


Since  u^(x,u)  < 1, 

(7.16)  Wn(Xn,M,u)  - Wn(Xn,M-1,u)  ^ 1 for  all  w. 


Clearly, 


(7.  17)  if  k( M , cj)  = °o , then 


Wn(Xn,M,d)  - Wn(Xn,M-1,u)  « k + e. 


Let  f(M,u)  be  the  indicator  function  of  the  set 
S(M)  = {u|  inf  [ M (r)(X+  e),M-l,u)  - n (k  + e,u)]  $ o}. 

n n n 

(7.  1 5)  - ( 7 . 17)  imply  that 

(7.  18)  WN(XN,M,u)-WN(XN,M-l,(j)  « (X  + c)  + f(M,u). 


Applying  E(  ) to  both  sides  of  (7.  18),  one  obtains 

(7.19)  VN(M,w)  - E(W(Xn,M-1)|^0)(u)  « k + e +E(f(M)|^0)(u») 
almost  surely. 


Since  S(M)  = {u|  M-  1 + inf  [ M ( r)(k+e) , 0 , u)  - rj  (k  + e,  u)]  < o}  , it 

n n n 

follows  that  for  every  u,  f(M,w)  is  continuous  from  the  left  and  non- 
increasing  as  a function  of  M.  Therefore,  by  Lemma  A.  1,  there  exists 
a measurable  function  6;  [0,«>)  XJ1  -*  (0,1]  such  that 

(i)  6(M,  . ) » E(f(M)|^0)  for  all  M and 

(ii)  for  almost  every  u,  6(M,u)  is  continuous  from  the  left  and  non- 


i 


b9tt 
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decreasing  as  a function  of  M.  By  (7.  19), 

V^fM.u)  - E ( W(X^  , M~  1)|  (u)  $ X + e + 6(M,uj)  almost  surely. 

In  order  to  complete  the  proof  of  (7.  11),  it  is  necessary  to  show 
that  lim  6(M,u)  = 0 almost  surely.  By  (6.4), 

lim  [ M^(  rj(X  + e),  0,  u)  - p (\  + e,u)]  = oo  almost  surely.  It  follows  that 
n— oo 

lim  f(M,u)  = 0 almost  surely.  Therefore,  by  (A.  2), 

M-*-oo 

lim  6(M,u)  = 0 almost  surely.  Since  for  almost  every  u, 

M — oo 
M an  integer 

6(M,u)  is  non-increasing  as  a function  of  M,  it  follows  that  almost  surely 

lim  6(M,uj)  = 0. 

M — *■  oo 

Q.E.D. 

I 

8.  PROOF  OF  THEOREM  3.2 

| The  outline  of  the  proof  is  as  follows.  The  fact  that 

Vj^M.u,)  > + 1 q(M,u)),u)  implies  that  the  random  variables 

Xn(Mn(Xn , M , w),  u)  form  a supermartingale.  By  the  convergence  theorem 
for  supermartingales,  these  random  variables  converge  almost  surely. 
Since  X^M.uj)  > X,  the  limit  is  at  least  X.  If  it  exceeds  X,  then  for 
some  e > 0,  X (M,u)  will  be  less  than  rj  (X-  e,u)  for  all  n.  Hence, 

‘I  Mn(Xoo,M,u))  converges  to  infinity.  Consequently,  by  the  main  theorem 

XniMniX^.M.wl.w)  will  converge  to  X.  This  contradiction  implies  that 
X (M  (X^,  M , w) , w)  converges  to  X. 


V 
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8.  1 Lemma 


The  random  variables  X.  (M  (X  , M,u),u)  form  a supermartingale. 

n n oo 

That  is,  for  all  n,  Kn(Mn(Xn,M  ,u),u>)  » E [Xn+1(Mn+1(Xoo,M))|^n](u> 


n+T  n+r  °o' 


almost  surely. 


Proof 


For  brevity,  M (X^.M.u)  will  be  denoted  by 
V^T  (M  , cj)  = V^(M,rnoj)  and  nq^(M,u)  = q^(M,rnu). 


Let 


n N 


(8.2) 


nMN' 


nV^(Mn(W),u>)  * nqN-l^n^  " xNn(Mn(uj),u),w) 

* nqN-l(Mn(w)'X=°n(Mn(u)'w)’u) 
" E<„  + lVN-l(Mn+l)K)(“>- 


The  first  inequality  above  follows  from  Lemma  4.1,  part  vii  and  from 
Lemma  A.  4.  The  second  follows  from  the  inequality  M-x^^M.u) 

^ M-xNn(M,u)  and  the  fact  that  nq^_j(M,u)  is  decreasing  in  M almost 
surely.  The  equality  follows  from  Lemma  4.1,  part  v and  from  Lemma 
A.  4.  Since  lim  n+1V^_  j ( Mn+1(u) , u)  = ^n+1( Mn+1(u) , u)  almost  surely 


N—oo 


it  follows  by  (A.  2)  that  lim  E 

N— oo 

almost  surely.  Also,  lim  nV^j(Mn(u),u)  = ln(Mn(u),u)  almost  surely, 


N— oo 


n n 


so  that  by  passage  to  the  limit  in  (8.2),  X-n(  Mn(u) , id) 


E ( \n+i<  Mn+ 1^  ^n^u^  almost  surely. 


Q.E.  D. 


By  the  convergence  theorem  for  supermartingales  (Doob  [6,  p.  324, 
Theorem  4.  10]),  Xn(M  (Xw,  M , id) , id)  converges  almost  surely.  Let 


_ 
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\JM,u ) be  the  limit.  Clearly,  \ JM.ru)  = XJM.u)  almost  surely. 

That  is  X.  (M,  . ) is  an  invariant  function.  It  is  easy  to  see  that 

because  the  stochastic  process  {un}  is  metrically  transitive,  every 

invariant  function  is  equal  to  a constant  almost  surely.  Let  ^ be  the 

constant  corresponding  to  . ). 

By  the  main  theorem,  X (M  (X  ,M,u),u>)  ^ X almost  surely,  so 
• n n °o 

that  X X.  It  must  be  shown  that  X = X. 

oo  oo 

In  what  follows,  use  will  be  made  of  the  concept  of  convergence 

in  probability.  A sequence  of  random  variables,  zn,  is  said  to  converge 

to  z in  probability  if  for  every  e > 0,  lim  Prob{  I z^  - zl  > e}  = 0.  zfi 

n-*“» 

converges  to  infinity  in  probability  if  for  every  K > 0, 

lim  Prob{  z < Kj  = 0.  If  z converges  almost  surely,  z converges 
-t  1 n 1 n n 

N-— °° 

in  probability. 

Suppose  that  X^  > X.  Observe  that 

X (M  u)  = n (X  (M  (X  , M , u) , u) , cj)  by  Lemma  5.  11.  Since 
oon  n n n oo 

lim  X (M  (X  , M,u).u)  = X almost  surely,  it  follows  that 
n n oo  °° 

n-*oo 


(8.3)  for  almost  every  cj,  X (M,u)^r)  (- 

sufficiently  large. 


for  n 


Since  lim  = <»  almost  surely  (by  (6.  3)),  it  follows 

n — -oo 

from  (8  3)  that  M (X  ,M,u)  converges  to  infinity  almost  surely  and 
n °o 

hence  in  probability.  Since  r is  probability  preserving,  it  follows  that 

M (X  ,M,T-nu;)  converges  to  infinity  in  probability. 

n oo 
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By  the  main  theorem,  lim  X <M,u>)  = X almost  surely  and  hence 

M— oo 

in  probability.  It  follows  easily  that  the  sequence  of  random  variables 

X (M  (X  M t nu)  u)  converges  to  X in  probability.  Again  using  the 
O n 

fact  that  r is  probability  preserving,  it  follows  that 

Xq(M  (X  ,M,u),Tnu)  = X^iM^X^, M , cj) , w)  converges  to  X in  probability. 
But  this  is  impossible,  since  X^  > X and  X^X^,  M , w) , u)  converges  to 
X almost  surely  and  hence  in  probability.  This  proves  that  X^  - X. 

oO 

It  has  been  proved  that  for  each  M,  lim  X (M  (X  ,M,u),u)  = X 

1 n n OC 

n-^oo 

almost  surely.  Clearly,  lim  X (M^X^,  M , w),  cj)  is  non-increasing  as 

n — oo 

a function  of  M,  for  almost  every  u.  Therefore,  for  almost  every  u, 

lim  X (M  (X  ,M,u),uj)  = X for  all  M. 
n n °o 

n— -so 

Q.E. D. 
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9.  THE  INFINITE  HORIZON,  DISCOUNTED  PROGRAM 

The  lemma  below  is  needed  in  the  proof  of  Theorem  3.  5.  Recall 

that  if  6 <1,  V,(M,u)  = lim  Vm.(M,u)  almost  surely  and 
6 N—°o 

x6  ( M , u.')  = lim  xN^n(M  ,w)  almost  surely.  Since  is  a non- 

n N — oo 

decreasing  function  of  N almost  surely,  lim  Vm.(M,u)  exists  almost 

N-*oo 

surely.  is  the  program  corresponding  to  the  plan  x^. 

9.  1 Lemma 

If  6 < 1 , then 

°C 

V (M,io)  = E(  £ 6nun<X6n(M))^o)(w) 
n=0 

almost  surely,  and  if  X is  any  feasible  program, 

OO 

V6(M,u)^e(  £ 6nun(Xn(M))|^0)(u) 
n=0 

almost  surely. 

This  lemma  says,  of  course,  chat  X^  is  an  optimal  program  for 
the  infinite  horizon  problem  with  discounted  utilities. 

Proof 

If  X is  any  feasible  program,  then 

OO  OO 

Y 6nu  (X  (M,u),u)  * I 6nX  (M  , w) 
lj  n n L->  n 

n=0  n=0 

OO 

« L 6nMn(X,M,u) 
n=0 

* Z 6n(M  + Z yk(uj))  • 

n=0  k=l 
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The  terms  of  this  last  series  are  non-negative,  so  that  it  converges, 
though  perhaps  to  infinity.  However,  by  the  monotone  convergence 
theorem  (Loeve  [8,  p.  1241), 

oo  n oo 

E Yj  6D(m+  Y yk)  = £ 6n(M+(n-l)Ey0)  < oo, 
n=0  k=l  n=0 

oo  n- 1 

so  that  the  series  T 6n^M  + V y^u))  converSes  to  a finite  limit 
n=0  k=l 

almost  surely.  It  has  been  proved  that 

(9.2)  For  almost  every  w,  there  is  a convergent  series  which 

OO 

dominates  Y ^ (M,u),u)  for  every  feasible  policy  X. 

n=0 

OO 

It  follows  that  Y ^nu  (X  (M,u),u)  converges  almost  surely. 
n=0  n n 

Next  observe  that  since  lim  xATI  (M,cj)  = x,  (M,u)  almost 

N-^oo  N6n  6n 

surely,  lim  M (XAT  . , M , w)  = M (X, , M , u)  almost  surely.  Hence, 

N — oo  n N6  n 6’ 

(9.3)  lim  u (XN,  (M,u),u)  = u (X.  (M,u),i<)) 

N— oo  n in  on  n on 

almost  surely  for  all  n. 

It  follows  from  (9.2)  and  (9.3)  that 
N-l  °° 

(9.4)  lim  Y 6nun(xN6n(M'u)-u)  = L ^V^n* M ’ U>  ’ w) 

N-*°o  n=0  n=0 

almost  surely. 


(9.4)  and  (A.  2)  imply  that 
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OO 

0.5)  lim  V^j6(M  ,cj)  = Yj  un^6n^^^0  ) almost  surely. 

X —+00  ~ 


Let  X be  any  feasible  policy.  Then,  by  Lemma  4.1, 


i\  - 1 

L ^nun(Xn(M))  |^0)  (w)  almost  surely. 


Hence,  (using  (A.  2)  and  (9.2)) 


OO 

Vg(M  , u)  = lim  VN6(M,co)>e(  £ 6n  un(Xn(  M))  | )(u)  almost  surely. 


Q.  E.  D. 


10.  PROOF  OF  THEOREM  3.5 


In  this  section  use  will  be  made  of  the  following  well-known 


theorem . 


Abel's  Limit  Theorem  (Ahlfors  [1,  p.  42]) 


a is  a sequence  of  numbers  such  that  lim  =rr  Y a exists 
n m „ N Lj  n 

N— oo  n 0 


oo  N-l 

then  lim  Y 6n  a = lim  7 a . 

* * i 6 u nM  N^-n 

n=0  N—oo  n=o 


10.  1 Lemma 


N-l 

lim  rr  ^ u ( ' 
1M  N LJ  n 
N-^00  n = 0 


if  1 u (X  (M.ud.u) 
in  -1  n oon 


= lim 
6 1 1 


1 1 n=0 


E Uq()7q(M)  almost  surely. 


54  - 


Proof 


By  Abel's  theorem,  it  is  sufficient  to  prove  that 
N-l 

n E un(Xoon(M,u),u)=E  uo(r)0(^))  almost  surely. 


n=0 


By  the  main  theorem,  > \ for  all  M almost  surely. 

Therefore,  = hn<  X^f  M^X^,  M , u) , u)>  w)  = nn(A,  co)  almost  surely 


oon 

for  all  n.  Hence, 

N-l 

1 

3 N 

N - "0  n=0 


1 L\~l 

’J'uPf  E un(Xoon(M-w)'u) 


j N-l 

« lim  sup  jj-  Yj  un(nn(\,u),w)  = EuQ(rj0(M) 

almost  surely.  The  equality  follows  from  (6.5). 

Since  EuQ(r70(t))  is  a continuous  function  of  t,  it  is  sufficient  to 
prove  that 


(10.2)  for  every  e>0, 

N-l 


^ inf  ^ E un(Xoon(M*u>'u)  ^ Eun(nn(\  + e)) 

N -*  oo  n=Q 
almost  surely. 


Since  lim  X (M  (X  M,u),u)  = X almost  surely,  it  follows  that 

n— -oo 

for  almost  every  u,  X^M.u)  ^ hn(X  + e,o j)  if  n is  sufficiently  large. 
Therefore,  for  almost  every  u, 

N-l 

N^inf  N Un(X-on(M*w)'u) 


n=0 


N-l 


> jLlm  N E un(n  (X  + e,to),w)  = Eun(r7  (\  + e)). 
N-^oo  n=0  11  u u 
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This  proves  (10.2). 


Q.E.D. 


Since  Pq(\,u)  is  uniformly  bounded  (by  Assumption  2.  5,  part  v) 


and  since  X^^M.u)  < nn(\,u))  = n0(X.,Tnu)  almost  surely,  it  follows 
that  the  functions 

i N;! 

N L u ,u),u)  are  uniformly  bounded.  Therefore,  by  the 

n=0 

Lebesque  dominated  convergence  theorem  and  Lemma  10.  1, 

N-l 

H E I = 

N^°°  n=0 

By  Abel's  theorem,  it  follows  that 


i 


s ; 


m \ 


|j 


k 


\im~  V 6nEu(X  (M))=Eu.(rin(M). 
c » , 6 n °on  0 0 

6tl  n=0 

This  proves  the  first  four  equalities  of  Theorem  3.  5 for  fixed  M. 

It  is  next  shown  that 

(10.3)  for  each  M , lim  inf  ^ V„(M  ,u)  > E un(rjn(M)  almost  surely. 

N — oo  L iN  u u 


By  part  iii  of  Lemma  4.1, 

Vn<M,u>®  E(  l VX.n<M,)|i,o)(u) 


N-l 

Z 

n=0 

almost  surely.  Therefore, 


N-l 


lim  inf  V (M,u)  » lim  inf  i-F,(  £ u (X  ( M))|  <?Q)  (u) 
N— oo  N op  n=0 

almost  surely.  By  (A.  2)  and  Lemma  10.1, 


■ i 


i- 
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2 Un<X.„(M)>^o)  -EVVX» 


almost  surely.  This  proves  (10.  3). 

Similar  arguments  prove  that 

(10‘4)  ^EVN(M'u)^  Euo(V^' 


(10.  5) 


HTtinf  V6(M>w)  * Eu0(rj0(\))  almost  surely,  and 


(10.61 


inf  EV5(M,u)i  Eu^^l)), 


The  proofs  of  ( 10.  5)  and  ( 10.  6)  require  the  use  of  Lemma  9.  1. 
Next,  it  is  proved  that 

(10.  7)  lim  sup  i-  V (M,u)  $ EuJijJX))  . 


N -►<»  N N ’ ' " ^uovV 


Since 


Eu0(r,0(X))  = Hm^lE(  £ %(-)„<  M)|  ) 


almost  surely,  in  order  to  prove  (10.  7)  it  is  sufficient  to  prove  that 


1 1 /N_1 

0*limsuPfjVN(M,u)-lim  jjE(  £ unl,n(l|)|s'  ) 

N^°°  n=0 

i r /n_i 

vn(m.U)-e(  i un(r,n(xi)|y0) 

°°  L n=0 

N-l 

N E(  ^ *VXNn*M^' W^^o)  almost  surely. 


For  each  N,  n,  M and  w,  there  exists  a unique  number  Z^n(M,u)  such  that 


un(XNn(M’u)'u)  ' un<r,n(X*u)*u)  * Un(ZNn(M  ’ u)  ’ u)(XNn(M  ’ u)  " VM  ’ u)) 
Therefore , 

N-l 

lim  sup  ^ E ( X (uo(XNn(M))'Un(VX)))^o) 

N— °°  n=0 

= lim  sup  ^ E ( Y u^(ZNn(M))(XNn(M)- nn(M)k0)  • 

N — oo  n=0 

Since 

N-l 

lim  ^ (Z  (XNn(M)-rjn(\))|^0)  = 0 almost  surely, 

N —oo  ' n=o 

N-l 

lim  sup  IE(  l uyZNn(M))(XNn(M)-nn(M)l^0) 

N — oo  n=0 

N-i 

= lim  sup  ^ E ( Y (un(ZNn(M)'X)(XNn(M)'r,n(M)^o) 

N-«>  n=0 

*£  0 almost  surely. 

The  last  inequality  follows  from  the  fact  that 

K(ZNn(M’u)'u)‘r)(XNn(M'u)_,7n<r*w>>  * °* 

This  completes  the  proof  of  (10.  7). 

Similar  arguments  prove  that 

(10.8)  lim  sup  ^ E V^(M)  ^ E uQ( >1q(  M)  , 

N — oo 

(10.9)  lim  sup  V^(M  , w)  ^ E Uq(  Pq(  X-))  , and 

6 1 1 

lim  sup  — E V (M)  < E uJpJX))  . 


(10. 10) 
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» 

(I 


f 


i 


m i 

I : 

1 1 


( 1 0.  3)  - ( 10.  10)  imply  that  for  each  value  of  M , the  last  four 
equalities  of  Theorem  3.  5 hold  almost  surely.  Since  all  of  the  limits 
appearing  in  the  theorem  are  almost  surely  non-decreasing  functions 
of  M , it  follows  that  for  almost  every  u,  all  the  equalities  of  the 
theorem  hold  for  all  values  of  M. 


11.  REMOVING  THE  UPPER  BOUND  ON  u'(x,u) 


It  has  been  assumed  that  u'(0,cj)  1 for  all  to.  This  assumption 

was  made  in  order  to  put  an  upper  bound  on  the  marginal  utility  of 
money.  This  bound  may  also  be  obtained  by  assuming  that  income  is 
bounded  away  from  zero.  (This  point  was  made  by  Schechtman  in  his 
dissertation  113]  . ) Specifically,  if  it  is  assumed  that  for  some  a > 0, 


yn(to)  5*  a almost  surely,  then  one  may  allow  lim  u'(x)  to  be  infinity 
u x-*0  u 


and  one  may  even  allow  lim  uQ(x)  to  be  minus  infinity.  It  is,  however. 


x-*0 


necessary  to  require  that  sup  u'(a,u)  < °°.  If  these  assumptions  are 

U)  u 


made,  all  the  theorems  of  section  3 remain  true.  Their  proofs  require 
only  a few  modifications. 

The  following  example  shows  that  if  the  restriction  on  yQ  is  not 
imposed,  then  the  main  theorem  is  false.  The  problem  is  that  if  the 
consumer  is  not  guaranteed  a positive  income  and  if  running  out  of 
income  is  disastrous,  then  the  limit  policy  could  require  the  consumer 
to  save  all  his  income,  no  matter  how  rich  he  might  be. 


Example 


rx  t'2 

For  0 < x < oo,  let  u(x)  3 J e dt. 

1 


; a 


1 


ll 
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Let  the  incomes,  yfi,  be  independently  and  identically  distributed  and 

suppose  that  Prob(y  = 0)  = Prob(v  = 1)=- 

n •'n  2 ' 


N-l 

Let  Vn(M)  = max  E £ u(x  ),  subject  to  0 <=  x « M , where 

n=0  n n 

Mq  = M and  Mr+1  = - xn  + yR+1  for  n > 0.  It  will  be  shown  that 


lim  V' (M)  = oo 
N— oo  1N 


Clearly,  V^(M)  ^ Prob(y0  » . . . = yN_1  = OjEtu'd^)!  yQ=.  . . =3 


• =yN-r0)- 


Also,  if  yQ  = . . . = 


^N-l  t^len  ^n-1  $ • Therefore 


VyM)»2'Nu'(f)  = 2 

2\N 

/ 


■N 


(~)2 


4N/M 


2\N 


Clearly, 


lim 

N— oo  \ 2 


N/M' 


- 00  , for  all  M. 


12.  POSSIBLE  GENERALIZATIONS 

It  has  been  assumed  throughout  this  paper  that  the  utility  function 
is  differentiable,  strictly  concave,  and  additively  separable.  It  should 
be  possible  to  eliminate  the  differentiability  and  concavity  assumptions 
altogether  and  to  weaken  the  separability  assumption  considerably. 
Elimination  of  the  differentiability  and  concavity  assumptions  introduces 
only  technical  difficulties.  If  the  separability  assumption  is  eliminated, 
it  must  be  replaced  by  some  other  set  of  restrictions.  It  is  not  clear 
what  these  should  be. 


■ . . •.  ■ 


The  intuitive  arguments  underlying  the  proof  of  the  main  theorem 

do  not  depend  on  the  differentiability  and  concavity  assumptions  at  all. 

It  might  seem  that  the  proof  would  collapse  because  the  policies  rj(t) 

would  be  undefined.  This  is  not  so.  It  is  true  that  if  u ( . ,u>)  were  not 

strictly  concave,  hn(t,u)  could  be  multiple  valued.  Nevertheless, 

En0(t)  could  be  defined  in  the  usual  way  as  {Ef|f(w)  <Ef  i,  (t,w>  almost 

surely  and  f is  measurable}.  (See  Aumann  [2]  for  a discussion  of 

integration  of  multiple-valued  functions . ) By  choosing  points  from  rj  (t  cj) 

,N:1  n ’ 

randomly,  it  is  possible  to  define  a policy  X for  which  lim  ir  V X (M  u) 

N^co  Nn^0  ‘ n ’ 

would  exist  almost  surely  and  would  equal  any  preassigned  oint  in 
E nQ( t).  Also,  E r?0(t)  would  be  a decreasing,  upper-semi-continuous 
multiple-valued  function.  For  these  reasons,  it  seems  that  it  would  be 
possible  to  carry  out  the  proof  of  the  main  theorem  and  the  other 

theorems  as  well.  However,  the  author  has  not  checked  the  proof  in 
detail. 


If  the  separability  assumption  were  eliminated,  some  restriction 
would  have  to  be  placed  on  interactions  across  time  within  the  utility 
function.  The  utility  function  should  be  time  invariant.  The  effect  on 
the  consumer's  decisions  in  one  period  of  changes  in  consumption  in 
another  period  should  become  negligible  as  the  time  separating  the  periods 
goes  to  infinity.  Similarly,  the  effect  on  the  consumer's  near  term  plans 
of  a change  in  the  time  horizon  should  become  negligible  as  the  horizon 
goes  to  infinity.  It  is  not  clear  how  these  conditions  should  be  formu- 


lated. 
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APPENDIX 

CONDITIONAL  EXPECTATIONS  OF  RANDOM  VARIABLES 
WITH  A PARAMETER 

Let  C be  some  set  of  properties  of  a real  valued 

function  of  a real  variable. 

Definition 

C is  said  to  be  conservable  if  the  following  is  true. 

Let  Q:  [0,oo)  X — [O.l]  be  any  measurable  function  such  that  for 

almost  every  u >,  the  function  Q(  . , u)  = [I),*)  — [0,  l]  has  properties  C. 
Then,  there  exists  a measurable  function  q:  [0,oo)  X £2  — [ 0 , 1 ] which 
satisfies  the  following: 

(i)  q(M,  . ) = E(Q(M)|^0)  for  all  M. 

( ii)  For  almost  every  u , q ( . , u):  [0 , <»)  — [0  , 1 ] has  properties  C. 
A.  1 Lemma 

Any  of  the  following  pairs  of  properties  is  conservable: 
continuous  and  strictly  decreasing;  continuous  from  the  right  and  non- 
decreasing; continuous  from  the  left  and  non-increasing. 


Frequent  use  will  be  made  of  the  following  fact. 


A.  2 Let  fF  be  a sub-cr-field  of  & and  let  z , be  a sequence  of  random 

variables  on  O such  that  lim  z,  = z almost  surely  and  | z,  (u)|  « Z(u), 

k -*•«■>  k K 

almost  surely  for  all  k,  where  E Z < °o.  Then,  lim  E(z,  | iT)=E(z|fT) 

k-»oo  K 


almost  surely.  (Doob  [6,  p.  23].) 


Proof  of  Lemma  A.  1 


Continuous  and  Strictly  Decreasing 

For  every  non-negative  rational  number  M let  q(M,  . ) be  any 
version  of  E(Q(M)|^q). 

For  each  pair  of  positive  integers,  k and  N,  let 

fN(k,u)  = sup  { I Q(  M2  , u)  - Q(  M 1 , u)l  | 0 ^ M1  < N,  Mj  ^ « Mj+k'1  } 

It  is  easy  to  show  that  for  every  k,  f^(k,u)  is  a measurable  function  of 

u.  Also,  since  for  almost  every  u,  Q(M,u)  is  continuous  in  M . it 

follows  that  lim  fN(k,u)  = 0 almost  surely.  Therefore,  by  (A.  2), 
k— -°o 

lim  E (f,T(k)l  SPn)  = 0 almost  surely.  Also,  if  M.  and  M_  are  rational 
k-«  NO  1 

and  0 $ Mj  « N and  Mj  « M2  ^ Mj+k  , then  | q(M  j ,u)  - q(M2  ,w)| 
s;  E(fN(k)|^0)(w)  almost  surely.  It  follow s that  for  almost  every  w, 

lim  lim  | q(M  - , u)  - q (M„  , u)|  = 0 

M “ " 


lim  lim 

M M2—  M 

Mj  rational  M2  rational 


for  every  M such  that  0 < M < N.  Since  this  statement  is  true  for  each 
of  the  countably  many  values  of  N , it  follows  that  it  is  true  with  N = °o. 


If  M is  irrational,  let 

q(M  ,u)  = lim 

Mf— M 
Mr  rational 


q(M',u)  , 


provided  that  this  limit  exists.  Otherwise,  let  q(M,u)  be  arbitrary. 

It  follows  from  what  has  just  been  proved  that  for  almost  every  10, 
q(M,w)  is  everywhere  well-defined  and  continuous  as  a function  of  M. 

It  is  easy  to  see  that  q is  measurable. 

It  is  next  proved  that  q(M,  . ) = E(Q(M)!S^q)  for  all  M.  Let  M^  be 
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a sequence  of  non-negative  rational  numbers  converging  to  M.  By 
definition,  q(M^,  . ) = E (Q( M^) | .S^)  for  all  n.  Since  almost  surely, 
q (t , u)  and  Q(t,u)  are  continuous  as  functions  of  t,  q(Mn,u)  and  QCM^.u) 
converge  to  q(M,u)  and  Q(M,u),  respectively,  almost  surely.  There- 
fore, by  (A. 2)  q (M , . ) = E(Q(M)|^q). 

It  remains  to  be  proved  that  for  almost  every  u,  q(  . , u)  is 
strictly  decreasing  as  a function  of  M.  If  and  M2  are  rational  and 
M1  < M2’  then  > q(M_,u)  almost  surely.  Since  there  are  only 

countably  many  pairs  of  rational  numbers,  it  follows  that  for  almost 
every  u,  q ( M j , u)  > q (M2 , u)  whenever  and  Mj  and  M2  are 

rational.  Since  q(  . , cj)  is  continuous  for  almost  every  u,  it  follows 
that  q ( . , w)  is  strictly  decreasing  for  almost  every  cj. 

Continuous  from  the  Right  and  Non-Decreasing 

For  every  rational  M,  let  q(M,  . ) be  a version  of  E(Q(M)I  Sf  ). 
Since  Q(M,w)  is  almost  surely  non-decreasing  in  M , it  follows  by  the 
argument  just  made  that  for  almost  every  u,  q(M,u)  is  non-decreasing 
as  M varies  over  rationals. 

If  M is  irrational,  let  q(M,u)  = lim  q(M,u).  For  almost 

M'j  M 

Mr  rational 

every  u,  this  limit  exists  for  all  M,  since  q(M,u)  is  almost  surely  non- 
decreasing on  rationals. 

By  definition,  q(M,u)  is  almost  surely  continuous  from  the  right 
at  irrational  values  of  M.  It  is  now  proved  that  the  same  is  true  at 
rational  values.  l or  each  rational  M and  each  positive  integer  k,  let 
f(M,k,w)=  sup{^(Mr,uj)-Q(M,u)|M^M'=SM+k'1}.  Since  Q(M  , u)  is 


continuous  from  the  right  almost  surely,  Jlm^  E (f  ( M , k) | 5^)  = 0 almost 

surely.  Therefore,  for  almost  every  u,  lim  (q(M', u)-q(M,u) ) = 0 

M'l  M 

Mf  rational 

Since  there  are  only  countably  many  rational  numbers,  M,  it  follows  that 

for  almost  every  u,  lim  (q(Mf , u)  - q( M , u))  = 0 for  all  rational  M . 

M'jM 

M'  rational 

In  order  to  prove  that  q(M,  . ) = E(Q(M)|^0)  for  all  M,  let  Mn  be 
a sequence  of  rational  numbers  converging  to  M from  the  right  and  use 
(A.  2). 

Arguments  similar  to  those  just  given  prove  the  lemma  for  the 
case  of  functions  which  are  continuous  from  the  left  and  non-increasing. 

Q.E. D. 

A.  3 Lemma 

Let  Q:  [0,°o)  X !2  - [0,°o)  be  measurable  and  suppose  that  for 
almost  every  u,  Q(M,u)  is  continuously  differentiable  as  a function  of 
M and  such  that  ^~Q(M,u)  is  positive,  less  than  or  equal  to  1,  and 
strictly  decreasing.  Let  Q'(M,uj)  be  any  function  which  equals 
j^j-Q(M,u)  whenever  this  derivative  exists. 

There  exists  a measurable  function  q:  [0,oo)  X Q -*■  [o  , 00 ) 
satisfying  the  following. 

(i)  For  almost  every  u,  q(M,u)  is  continuously  differentiable  as 
a function  of  M.  The  derivative  is  positive,  less  than  or  equal  to  1, 
and  strictly  decreasing. 

Let  qf( M , to)  denote  any  function  equal  to  -^j-q(M,to)  whenever  this 
derivative  exists . 


(ii)  q(M,  . ) = E(Q(M))^0)  and 

q'(M,  . ) =E(Q'(M )|^Q)  , for  all  M. 


Proof 


Since  Q is  measurable,  Q'  is  so  as  well.  Therefore,  one  may 
apply  Lemma  A.  1 to  Q'  and  obtain  q'  as  in  the  lemma  to  be  proved. 

Let  q(M,u)  - J q'(t,u)  dt.  It  follows  from  the  Fubini  theorem 
(Lo£ve  [8,  p.  1 2 5 1 ) that  q satisfies  property  (ii)  in  the  statement  of 
the  lemma. 

Q.E . D. 


A.  4 Lemma 

Let  Q:  [0,°o)  Xfi  - [0,oo)  and  q:  fo,=o)  X Q - [0,oo)  be  measur- 
able and  such  that  for  almost  every  u,  Q(M,u)  and  q(M,u)  are  continuous 
functions  of  M.  Suppose  that  for  every  M,  q(M,  . ) = E(Q(M)j^)  If 
z:  £2  — [0 , °o)  is  measurable  with  respect  to  and  such  that 
e|q(z)|  < oo,  then  q(z(  . ),  . ) = E(Q(z)|.^  ). 

Proof 

Let  z^:  S2  — [O,oo)  be  a sequence  of  simple  functions,  which  are 
measurable  with  respect  to  and  converge  to  z almost  surely.  Since 
zn  is  simple,  q(zn(.),.)  = E(Q(zn)|^).  By  (A. 2)  and  the  continuity 
properties  of  q and  Q,  q(  z(  .),.)  = E(Q(  z)|  S'). 


..  mi. .. 


Q.E.D. 


A.  5 Lemma 


Let  f : [0,oo)  X n — - [ 0 , 1 ] be  a sequence  of  measurable  functions. 
Suppose  that 

(a)  for  almost  every  u,  fn(M,oj)  is  continuous  from  the  right  and 
non-decreasing  as  a function  of  M,  and 

(b)  for  almost  every  u,  lim  f (M,u)  = 0. 

n— oo  n 

Then,  there  exists  a sequence  of  measurable  functions 

^n:  [0,°°)  * ^ — [0 , 1 ] with  the  following  properties. 

(i)  6 (M)  = E(f  (M)|^_)  for  all  M. 

n n 0 

(ii)  For  almost  every  u,  6n(M,u)  is  continuous  from 
the  right  as  a function  of  M. 

(iii)  For  almost  every  u,  lim  6 (M,u)  = 0 for  all  M. 

n— oo 

Proof 

By  applying  Lemma  A.  1 to  f one  obtains  6^  satisfying  (i)  and 
(ii)  above.  Clearly,  for  almost  every  u.  lim  6 (M,w)  = 0 for  everv 

j • rj  ►oo  n J 

positive  integer  M.  Since  6 ( M , w)  is  non-decreasing  in  M for  almost 

every  u,  it  follows  that  lim  6 (M,u)  = 0 for  all  M 

n 

n — -oo 

Q.E.  D. 


A.  6 Lemma 

Let  f:  [0,oo)  X n — (-oo,oo)  be  measurable  and  such  that 
(i)  for  each  M,  f(M,u)  » 0 almost  surely  and 

(ii)  for  almost  every  u,  f(M,u)  is  continuous  from  the 
right  as  a function  of  M,  or 


mmmmesm 


- 67  - 


(iii)  for  almost  every  u,  f(M,u)  is  continuous  from  the 
left  as  a function  of  M. 

Then,  for  almost  every  u,  f(M,u)  5*  0 for  all  M. 


Proof 

The  lemma  follows  at  once  from  the  fact  that  for  almost  every  u, 
f(M,w)  > 0 for  all  rational  values  of  M. 


Q.E. D. 


BIBLIOGRAPHY 


1 . Ahlfors  , Lars  , Complex  Analysis  , third  edition 

(McGraw-Hill,  New  York:  1966). 

2.  Aumann,  Robert,  "integrals  of  Set- Valued  Functions  , " Journal  of 

Mathematical  Analysis  and  Applications,  12  (1965)  pp.  1-12. 

3.  Bewley,  Truman  , "Price  Stability  and  the  Permanent  Income 

Hypothesis . " 

4.  , "Welfare  Economics  and  the  Permanent  Income 

Hypothesis . " 

5.  Brock,  William  and  Leonard  Mirman,  "Optimal  Growth  and 

Uncertainty:  The  Discounted  Case,"  Journal  of  Economic 
Theory,  4 (1972)  pp.  479-513. 

6.  Doob,  J.L.,  Stochastic  Processes  (Wiley  end  Sons.  New  York:  1963). 

7.  Friedman,  Milton,  A Theory  of  the  Consumption  Function 

(Princeton  University  Press  , Princeton,  N.J.:  1957). 

8.  Lo&ve,  Michel,  Probability  Theory,  third  edition  (D.  van  Nostrand, 

New  York!  1955). 

9.  Mirman,  Leonard  and  Itzhak  Zilcha , "Characterizing  Optimal 

Policies  in  a One  Sector  Model  of  Economic  Growth  Under 
Uncertainty,"  mimeographed  (University  of  Illinvis, 
Urbana-Champaign , Jan.  1976). 


10.  Modigliani,  F.  and  R.  Brumberg,  "Utility  Analysis  and  the  Con- 

sumption Function:  An  Interpretation  of  Cross-Section 
Data,"  in  K.  Kurihara,  ed.  Post  Keynesian  Economics 
(New  Brunswick:  1954). 

11.  Projector,  Dorothy  and  Gertrude  Weiss  , "Survey  of  Financial 

Characteristics  of  Consumers  " (Board  of  Governors  of 
the  Federal  Reserve  System:  Aug.  1966). 

12.  Radner,  Roy,  "Optimal  Stationary  Consumption  with  Stochastic 

Production  and  Resources,"  Journal  of  Economic  Theory 
6 (Feb.  19  73)  pp.  68-90. 

13.  Schechtman,  Jack,  "Some  Applications  of  Competitive  Prices  to 

Dynamic  Programming  Problems  Under  Uncertainty," 
mimeographed.  Operations  Research  Center,  University 
of  California,  Berkeley,  1973. 

14.  -,  "An  Income  Fluctuation  Problem,"  Journal 

of  Economic  Theory  12  ( 1976)  pp.  218-241. 

15.  Yaari,  Menahem,  "A  Law  of  Large  Numbers  in  the  Theory  of 

Consumer's  Choice  Under  Uncertainty,"  Journal  of 
Economic  Theory  12  (1966)  pp.  202-217. 


Truman/ Bewley 


Unclassif ied 


DOCUMENT  COMT'iQl.  DATA  - £,  D 

(\  i l.i%  \ t f i'  i in  ‘ f 1 1 t/f,  !\  , f , • i-t  J a,,  f \ ■ irii.nl  iti  ,n  <■  it  •*  I /»«  fiitt  ffd  u hi  i,  tin'  tvffj//  rvporf  is  classified) 


» 0:<l01NATlN«i  AClIVtn  iCorr-’r  it e nu  that)  |*«».  NL  » T SECURITY  CLASSIFICATION 


Project  on  Efficiency  of  Decision  Making  in 
Economic  Systems,  1737  Cambridge  St.,  //404, 
Harvard  University}  Cambridge,  Mass.  02138 


Unclassified 


THE  PERMANENT  INCOME  HYPOTHESIS:  A THEORETICAL  FORMULATION  * 


HE  Mn  T y «n  f y-  cf  report  mud  inclusive  latr% 


It  Technical  ^epol’t:,  No.  25 


Tdd'.e  initial. 


(7£me-  s 


^ CONTRACT  OR  GRANT  NO.  --  |l“  ORIGINATOR**  REPORT  NUMfcjEKiS) 

' N0Qgl4-67-A-O298-OQ19>  /VS  f - GS~3789/j 

_t"  rncj_0 T ri*  / — I Technical  Report  No.  25 

NR-47-004  , 


OTHER  REPOR  X NO(S)  (Any  other  nuruL/tts  that  may  be  assigned 
this  report) 


This  document  has  been  approved  for  public  release  and  sale;  its  publication  is 
unlimited.  Reproduction  in  whole  or  in  part  is  permitted  for  any  purpose  of  the 


United  States  Government. 

m Supplementary  notls 


Logistics  and  Mathematics  Statistics 
Branch,  Department  of  the  Navy, 

Office  of  Naval  Research,  Washington,  D.  C. 


This  paper  defends  the  view  that  in  dealing  with  a consumer's  reponse  to 
short-term  changes,  it  is  reasonable  to  assume  that  the  marginal  utility  of 
money  is  constant.  A theoretical  defense  of  this  view  is  made  in  terms  of  the 
consumer's  intertemporal  maximization  problem.  It  is  assumed  that  the  consumer 
may  hold  money,  but  may  not  borrow.  The  consumer's  utility  function  is  assumed 
to  be  additively  separable  with  respect  to  time.  Prices,  the  consumer's  income, 
and  his  utility  function  for  each  period  are  assumed  to  fluctuate  according  to  a 
stationary  stochastic  process.  It  is  proved  that  if  the  time  horizon  of  the 
consumer's  problem  is  sufficiently  distant,  if  his  discount  rate  for  future 
utility  is  sufficiently  small,  and  if  he  has  a sufficient  quantity  of  money,  then 
the  marginal  utility  of  money  is  nearly  independent  of  current  prices  and  income 
and  is  nearly  constant  over  time.  The  proof  of  these  facts  is  based  on  economic 
common  sense  and  the  strong  law  of  large  numbers  for  stationary  processes. 


DD  ,Fr:.,1473  IP4GE'’ 

S/N  (1IOI.6O7.C6OI 


Unclassified  .2 

Security  Classification 


